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Abstract. In this paper, we consider the problem of estimating the covariation of two diffusion processes 
when observations are subject to non-synchronicity. Building on recent papers [18, 19], we derive second- 
order asymptotic expansions for the distribution of the Hayashi-Yoshida estimator in a fairly general 
setup including random sampling schemes and non-anticipative random drifts. The key steps leading to 
our results are a second-order decomposition of the estimator's distribution in the Gaussian set-up, a 
stochastic decomposition of the estimator itself and an accurate evaluation of the Malliavin covariance. To 
give a concrete example, we compute the constants involved in the resulting expansions for the particular 
case of sampling scheme generated by two independent Poisson processes. 

Resume. Dans cet article, nous considerons le probleme d'estimation de la covariation de deux processus 
de diffusion observes de fagon asynchrone. Nous nous plagons dans le cadre presente dans [18, 19] et 
etablissons un developpement asymptotique au second ordre de la loi de I'estimateur de Hayashi-Yoshida. 
Ce developpement est valable pour les drifts aleatoires non-anticipatifs et pour des pas d'echantillonnage 
irreguliers, eventuellement aleatoires, mais independant des processus observes. L'approche utilisee pour 
obtenir les principaux resultats pent etre decomposee en trois etapes. La premiere consiste a etablir 
un developpement au second-ordre de la loi de I'estimateur dans le cadre Gaussien. La deuxieme est 
I'obtention d'une decomposition stochastique de I'estimateur lui-meme et la dernire est revaluation de 
la covariance de Malliavin. A litre d'exemple, nous calculous les constantes du developpement au second 
ordre dans le cas oil I'echantillonnage est obtenu par deux processus de Poisson independants. 

Keywords: Edgcworth expansion, covariation estimation, diffusion process, asynchronous observations, Poisson 
sampling. 



1. Introduction 

In the last decade, studies on covariance estimation has attracted considerable attention thanks to 
the applications in mathematical finance and econometrics; see e.g. Andersen and Bollerslev [1], 
Comte and Renault [9], Andersen et al. [2, 3], BarndorfF- Nielsen and Shephard [6]. All these papers 
consider the situation where two diffusion processes are observed at the same discrete instants. In 
contrast with this, covariance estimation under a "non-synchronous" sampling scheme has rarely 
been treated theoretically in spite of its importance in the analysis of high-frequency financial 
data [39, 27, 41]. The first contributions to the statistical inference for covariance estimation 
with non- synchronous data have been made by Hayashi and Yoshida [18, 19]. They proposed 
an estimator of the covariation and explored its statistical properties such as the consistency 
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and the asymptotic normality. Interestingly, it follows from the results in [19] that the drifts 
of the observed diffusions do not affect the asymptotic variance of the covariance estimator. 
The aim of the present paper is to complement the results in [18, 19] by establishing a second- 
order asymptotic expansion for the distribution of the covariance estimator. In particular, we get 
explicit expressions that have the advantage of reflecting the impact of drifts on the asymptotic 
distribution of the estimator. 

One common approach to cope with non-synchronicity is the following. First, two regularly 
spaced time series are generated by interpolating the observed non-synchronous data. Then the 
realized covariance estimator is computed for the interpolated time series. However, it is known 
that such a synchronization technique causes estimation bias, which is often referred to as the 
Epps effect [11]. Another estimator of the covariance, based on the harmonic analysis, has been 
proposed by Malliavin and Mancino [28]. In the case where in addition to the non-synchronicity 
the data is contaminated by a microstructure noise, estimators of the covariance have been 
proposed by Palandri [33], BarndorfF- Nielsen et al. [5] and Zhang [46]. A detailed account on 
covariance estimation for non-synchronous data can be found in [20] and [46]. 

In order to present the framework and to describe our contributions, we need some notation. 
Let X = {Xi,X2) be a two dimensional diffusion process given by 



where B = {{Bi^t,B2,tV , t > 0) is a two dimensional Gaussian process with independent 
increments, zero mean and covariance matrix 



In (1), f3 ~ (/3i,/32)'^ is a progressively measurable process, cr ~ {o'i,cr2)'^ is a deterministic 
function and diag((T) stands for the diagonal matrix having a; as i"^ diagonal entry, i = 1,2. In 
what follows, we restrict our attention to the case when cti, (T2 and p are deterministic functions; 
the functions a;, i = 1,2 take positive values while p takes values in the interval [—1, 1]. Note 
that the marginal processes Bi and B2 are Brownian motions (EM). Moreover, we can define a 
process B^ such that {Bi^t, B^)t>o is a two-dimensional BM and dB2.t = PtdBit + \J\ — p\ dB^ 
for every t > 0. 

We will assume that the processes Xi and X2 are observed respectively at the time instants 
= 5'° < S*! < . . . < S-^i = T and = < . . . < = T. Let us denote P = (S'-\ S'] 
and .P = (TJ^\r^]. The families = {P,i = l,...,iVi} and = = l,...,iV2} 

are partitions of the interval [0,T]. We will also use the notation AiXi = Xi gi — Xi gi-i and 

AjA'2 = X2^Ti ~ Ar2,T3~i- 

In this paper, we are concerned with the problem of estimating the parameter 



0= Pt<7i,ta-2,tdt = {Xi,X2)t 
Jo 

based on the observations {Xi gi , X2^t3 : * = 0, . . . , A^i , j = 0, . . . , A^2)- The parameter 6 represents 
the covariance between the martingale parts of Xi and X2. Therefore, it can be used to evaluate 
the correlation between the two BMs Bi and B2 ■ 

If the processes Xi and X2 are synchronously observed, the sum of cross products X^il^i ^i^i ■ 
AiX2 is a natural estimator of 9. Indeed, it converges in probability to 9 when the maximum lag 
of the sampling times tends to in probability. In the field of statistical inference for stochastic 
processes, this fact has been applied to estimating the volatility and the covariation between 
semimartingales. The asymptotic distributions are well investigated; see Dacunha-Castelle and 
Florens-Zmirou [10], Florens-Zmirou [12], Prakasa Rao [34, 35], Yoshida [44], Genon-Catalot and 
Jacod [14], Kessler [26], and Mykland and Zhang [31]. 



dXt = /3^dt + diag(crj) dB 



(1) 
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An estimator of 9, which is unbiased when the drift f3 is identicahy zero, has been proposed 
in [18]. Henceforth called HY-estimator, it is defined as follows: 



It is established in [18] that under mild assumptions, is consistent as the maximum lag of the 
sampling times tends to in probability. Kusuoka and Hayashi [17] extended the consistency 
result to a more general sampling scheme. Asymptotic normality of the HY-cstimator was proved 
in Hayashi and Yoshida [19] under the assumption that the sampling times are independent of 
the process X. For related literature, see Hoshikawa et al. [22], Griffin and Oomen [15], Robert 
and Rosenbaum [37] and Voev and Lunde [43] . The general case of a sampling scheme depending 
on the process X has been studied in Hayashi and Yoshida [20, 21], where a stochastic analytic 
proof of the asymptotic mixed normality of the HY-estimator is presented. An estimator for the 
variance of the HY-estimator under the assumption that the observed process X has no drift has 
been recently proposed by Mykland [30]. 

In the present work, the main emphasis is put on the higher-order asymptotic behavior of 
the HY-estimator. Note that the theory of asymptotic expansions is one of chapters of statistics 
that received a revival of interest owing to its usefulness for exploring properties of bootstrap- 
based statistical methods. For a comprehensive introduction to this subject we refer the reader to 
Hall [16]. Results on asymptotic expansions in other contexts can be found in Bose [8], Mykland 
[29], Koul and Surgailis [25], Bertail and Clemengon [7], Zhang et al. [47], Fukasawa [13] and the 
references therein. 

Section 3 contains an asymptotic expansion of the distribution of the HY-estimator. As a 
first step for deriving asymptotic expansions for the distribution of the HY-estimator, we give 
in Section 3.2 a representation of the cumulants of 9 as functionals of the sampling times, and 
obtain asymptotic estimates for them. This is used to derive a second-order asymptotic expansion 
of the characteristic function of the estimator while the asymptotic normality is also proved as 
an application of those estimates. 

The application of these results in the setup of Poisson sampling schemes is presented in Section 
4. We assume that the Poisson processes generating the sampling times have constant intensities 
npi and np2-, where n is a parameter guaranteeing the high-frequency of the observations {n — > 
oo). This setup has the advantage of making it possible to compute all the quantities involved in 
the asymptotic expansion. We show that the residual term in the proposed asymptotic expansion 
of the distribution of \fn(9n — 9) behaves nearly like n~^, as n goes to infinity. 

When there are (possibly random) drift terms in the stochastic differential equation of Xt, 
some additional terms appear in the asymptotic expansion. In order to identify these terms, we 
derive in Section 5 a stochastic decomposition of the HY-estimator and explore the asymptotic 
behavior of the variables appearing in the second-order terms. Since the asymptotics we get is 
non-Gaussian, the classical techniques leading to Edgeworth expansions can not be used. Instead, 
our arguments rely on the limit theory for semimartingales. 

The asymptotic expansion of the distribution of the HY-estimator is carried out in Section 6 
using a perturbation method. We apply the Malliavin calculus first to ensure the regularity of the 
distribution of the principal part — a quadratic form of Gaussian random variables — and then to 
extend this property to the model under the perturbation. To enhance the legibility, we postpone 
the most technical proofs to the last three sections. 

2. Elementary properties of 

As noticed by Mykland [30], the estimator 6 is the Maximum Likelihood Estimator (MLE) of 
9. Let us present here some computations that not only show that 6 is the MLE of 6, but also 



Ni N2 




(2) 



1=1 j=i 
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give some interesting insight eoncerning the efficiency properties of the HY-estimator 9. Let 
us deal with a slightly more general setup. Assume that ^ G is a random vector having 
centered Gaussian distribution with unknown covariance matrix E. The entries of the matrix E 
are ai^i' = E[S^i£_g'] for £,(.' = \, ... . We want to estimate a linear combination 

N 

where ae^t € K, £, £' = 1, . . . , iV are some known numbers verifying agj' = ae'^i. 

In order to use results on the exponential family, it is convenient to consider the parametrization 
by the entries of the inverse, denoted by = E^^, of the covariance matrix E. Set p = {N^+N)/2 
and write 



V 



I Vi V2 ... Vn \ 

V2 Vn+1 ■■■ V2N-1 



\VN V2N-1 ■■■ Vp J 

The log-likelihood function can now be written as follows: 



i{y)^l\og\v\-\j2v,Mi). (3) 
fc=i 

where \V\ denotes the determinant of the matrix V and T(£) = (Ti(£), T2(^), . . .) is defined by 

It follows from (3) that the distribution Py of the Gaussian vector ^ ~ A/'Ar(0,F^^) belongs to 
the (simple) exponential family. This implies that the statistic T(^) is the MLE of the parameter 

r = i?[T(|)] = (tTii, 2cri2, . . . ,(7nn)'^ ■ Hence, the MLE of 6* = Y.i/' 0'i,i'<^e,e' is 6* = J2e,e' ae,e'CeS.i'- 
It is easily seen that this estimator is unbiased. Furthermore, since T(^) is a complete sufficient 
statistic, the MLE 6 = ^, a^j'^e^e' is the best unbiased estimator of 9 in the sense that any 

other unbiased estimator will have a variance at least as large as that of 9. 
We can now return to our model. The vector 

^ = (AiXi, . . . , Aat^Xi, A1X2, . . . , An,X2)'^ 

is drawn from an = A'^i + N2 dimensional centered Gaussian distribution. In addition, the 
parameter 9 = Cov{Xi t, X2^t) can be represented in the form t with 

= ^ < > ^1.-^' n y-^i ^ 0) 

for every I < i' and ai^ii = agi for I > i' . Therefore, the arguments presented above yield the 
following result. 

Proposition 1. The estimator 9 defined by (2) is the MLE of 9. Moreover, it is the estimator 
having the smallest quadratic risk among all unbiased estimators of 9. 

This proposition advocates for using the HY-estimator in the case where /3 = 0. If the latter 
condition is not satisfied, 9 is not necessarily unbiased, but under very mild assumptions it is 
consistent [18] and asymptotically normal [19] as the maximum lag of the sampling times tends 
to 0. This explains the popularity of the HY-estimator motivating our interest in its second-order 
asymptotic expansion. At a heuristical level, the construction of the HY-estimator can be derived 
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from the decomposition 9 ~ J2i j -'-(-^' ^ J'' 7^ ^) IiinJj '^i t'^^-tPt dt. Indeed, each term of that 
decomposition is nearly equal to the covariance of the increments AiXi and AjX2, since the mar- 
tingale part of a small increment of a semi-martingale dominates the increment of the bounded- 
variation part. Hence, if P and are small, it is reasonable to estimate /fipjj cri^tcf2,tpt dt by 
the product A^Xi • AjX2 and, therefore, to estimate 6 by the HY-estimator 9. 

3. Asymptotic expansion of the distribution in Gaussian setup 

3.1. Notation and main results 

In this section, we will derive the second-order asymptotic expansion of the distribution of 

— 1/2 " 

bn {On — 0), where &„ is a suitably chosen normalization factor, for the model (1) without 
drifts. We will treat a model with drifts in Section 5, where we will resort to the Malliavin 
calculus for dealing with general nonlinear Wiener functionals. 

Given positive numbers M and 7, let £{M, 7) denote the set of measurable functions / : M K 
satisfying \f{x)\ < M{1 + \x\'') for all x G M. For positive numbers C, 77, tq and c* we set 



£0-f"(C,77,ro,c*) = f/: f Cj f{z,r)^{z; c*)dz < Cr\ Vr < roj. 



where 

uif{z,r)= sup \f{z + x) - f{z)\ 

x:\x\<r 

and is the density of the centered normal distribution with variance S. Note that this 

class is large enough to contain most functions that are encountered in practice. In particular, 
all functions satisfying the generalized Holder condition |/(z -I- a;) — f{z)\ < F{z)\x\^ with some 
function F such that J F{z)(j){z; c*) dz < C belong to £°(C, 77, 00, c*). It is also easy to check that 
the set of all indicator functions of intervals of M is included in f °(-\/27rc*, 1, 00, c*) for any c* > 0. 

Our aim is now to get uniformly in / G 5* an asymptotic expansion for the sequence 
E[f{bn^^'^{en - 0))] with £* = £{M,j) £"(C, 77, tq, c*). To this end, define as the 

r-th Hermite polynomial given by 

K{z; E) = {-lY(l){z; J:y^dl(j){z; S), Vz e R. 

In particular, /i2(z;S) = (z^ - and h^{z]T) = (z^ - SSz)/!]^. Along with the Hermite 

polynomials, it is customary to express the second-order asymptotic expansion of a distribution 
in terms of the first-order and the second-order cumulants. To define this quantities in the present 
framework, let us denote, for any Borel set S* C K, 

v{S) ^ I pt(Ji.ta2.tdt, vi{S) = / alfdt, V2{S) = / al^dt, (4) 
Js Js ' Js 

and introduce 

P2^\[Y.v,{I)v2{J)Ku+ v{lf+ -^«(/njf}, (5) 

/,./ /eni ,/en2 jj 

-"3 = J{ E E «(^)'+2E«(^nJ)^ + 3^t.i(/)t;2(JM/U J)if,j 

/eni jgn2 i,j jj 

- sEft'Un J)2(«(/) + - viinJMiHJ)]], (6) 



where Kjj = l(/n J ^ 0) and J2ij — S/eni Ejen^- Since we are dealing with the asymptotics 
of high frequency data, we will assume that all the intervals P = 7*^ and = J,{ depend on some 
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parameter n — representing the frequency of the sampling — that is large. To make the dependence 
on n explicit, we will write ^2.n and /i3_„ instead of /i2 and /is. Furthermore, as the time interval 
[0,T] is fixed, the maximal sampling step r„ = [(max^ |/^|) V (max-,- | J^|)] is assumed to tend to 
zero as n — > oo. Using this notation, we define 



and 



^3,71 — 8 6„^^3_„, 



(7) 



for some deterministic sequence 6„, tending to zero as n — > oo. To some extent, one can think of 
bn as the rate of convergence of //2,n to zero. This point will become clearer in Section 4, where 
the concrete example of the Poisson sampling scheme is analyzed. 

We introduce a cr [n]-dependent random signed-measure ^'JJ on M by the density 



(z;A2,„) 1 + — ^Aa.n /i3(z; A2,„) 
6 



It is not hard to check that the Fourier transform of ^'JJ is given by 



.1/2 

6 



In the case where no assumption on the convergence of ^2,n is made, the measure will serve 



as the second-order approximation to the distribution of <Y„ 



-1/2 



{9n — 6). However, for many 



sampling schemes one can prove the convergence of A2,n to some constant c, implying that the 
estimator 9n is asymptotically normal with asymptotic variance c. It is therefore natural to 
address the issue of approximating the distribution of Xn by a measure similar to but based 
on the Gaussian density with variance c. To this end, we define the signed measure on M by 
the density 



9 (^2,n 



c)h2{z; c) + -— A3,„ h3{z; c) 




The following result, the proof of which is deferred to Section 7, asserts that p3.„ and p^.n are 
good approximations to the density of (0„ — 9)/ ^/b^. 

Theorem 1. Let M, 7, 77, C, rp, c* > be the parameters describing the set of functions of interest. 
For a e (|, 1) and c, Co, Ci g (0, c*) set 

Vn{co, ci,a) = { Co < A2,„ < ci, r„ < 6"^ }, 

An{a) = { {X-i.n - c)' < bl--\ r„<bl}, 

where r„ is the maximal lag of the sampling times and X2.71 ~ 26^^^2,n- Then, there exists a 
sequence Cn = in{M, 7, 77, C, tq, a, Co, Ci) such that e„ ~ 0{b^~'^) and the inequalities 



sup |En[/(A'„)]-*,?[/]| <e„, 

/G£(A/,7)n£0(C,»;,ro,c*) 



sup 

/e£(A/,7)n£0(C,r,,ro,c') 



vn„ e 7'„(co, ci,a), 
vn„ e A„(a), 



(8) 
(9) 



hold true, where Xn = bn^^'^iOn — 9). 

Remark 1. The approximating measure provided by Theorem 1 contains the Gaussian 
density with variance A2,„; which depends on n. One can easily deduce from that result that the 
distribution of (&n^2,ri)~^^^(^n ~ 9) can be approximated by the measure 



'bnX^.n 



^ 4>{z;l)dz. 
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The following result is an immediate consequence of (9) and provides an unconditional asymp- 



totic expansion for the distribution of Xn = bn 



1/2, 



Theorem 2. Under the notation of Theorem 1, if P(j4„(a)'^) ~ o(&^) for every p > 1, and 
n\n-t]=0{bl^-^), then 



sup 

/e£(J\/,7)n£0(C,»;,ro,c*) 



nf{Xn)]~ / f{z)pUz)dz 



(10) 



where p'^{z) = 0(2:; c) 1 H — ^E[A3^„] /i3(z;c) . Moreover, i/ sup„gj^ E[A3_„] < oo, then relation 
(10) holds with p'^ replaced by 



max(0,p;(z)) 
J^max{0,p*^{u))du ' 



which is a probability density. 



3.2. Gaussian analysis and expansion of the characteristic function 

The goal of this section is to prepare the ground for the proof of Theorem 1. To this end, we 
present in Section 3.2.1 general results on the characteristic function of a random variable that can 
be written as a quadratic functional of a standard Gaussian vector. As usual, this characteristic 
function involves the cumulants that take a simplified form in the context of the HY-estimator. 
Section 3.2.2 is devoted to proving that the second and the third cumulants for the HY-estimator 
can be computed using formulae (5) and (6). These results lead to a second-order expansion of the 
characteristic function of the HY-estimator, which is rigorously stated and proved in Section 3.2.3. 
Finally, the proof of Theorem 1 is presented in Section 3.3. 

3.2.1. General Gaussian setup 

In order to determine the asymptotic expansion of the distribution of 9, we start with expanding 
its characteristic function. It will be useful for our purposes to consider the more general setup 
defined via Gaussian vector ^ and the matrix A — (af,<")«'=iJ see Section 2. 
Recall that 

e^i^Ai and C-AAAr(0,S). 

In other terms, is a quadratic form of a centered Gaussian vector. The aim of the present 
subsection is twofold. Firstly, we compute the cumulants of any quadratic form Q of a Gaussian 
vector ^ as functions of the matrix associated to the quadratic form Q and the covariance matrix 
of ^. Among other things, this computation allows us to give a simple condition implying the weak 
convergence of a series of quadratic forms of Gaussian vectors. The second goal of the present 
subsection is to show that the tails of the characteristic function of a quadratic form of a Gaussian 
vector have at least polynomial decay. To achieve this second goal, we establish an explicit upper 
bound for the characteristic function of interest. It should be pointed out that most results and 
conditions are stated in terms of the spectral characteristics of the matrix S^/^^E^/^. 

Since ^ is a symmetric matrix, the N-hy-N matrix Ti^/'^AT,^/'^ is symmetric and therefore 
diagonalizable. Let A and U be respectively the N-hy-N diagonal and orthogonal matrices such 
that £1/2^^1/2 = U'^AU. Let C be a Gaussian A/WCO, In) vector such that | = S^/^ • U'^C- Such 
a vector exists always and it is unique if E is invertible. In this notation, we have 

N 

e=i 
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where Ai, . . . , \n are the eigenvalues of the matrix Y}/"^ AY}/"^ and Ci> • ■ • i are independent 
Gaussian random variables. This implies that (^^s are independent and distributed according to 
the x\ distribution. Hence E[e™^?] = (1 - 21^)"^/^ and 

N 
£=1 

By taking the logarithm and using its Taylor series we get 



k 

= 1 1=1 k=l 



log^,-(w) = --^log(l-2iAH= 



as soon as |u| < 1/(2 max^ lA^I). Since all the series in the above formula are absolutely convergent, 
we can change the order of summation. This yields 

log<^,-(^.) = l"l < l/(2||A||oo), (11) 



with ||A||oo = max^ \Xi\ and fik = J2e=i = T^Ai'^^''^ AY?-/^ f] = Tr[(I] • A)% where the last 
equality follows from the property Tr(Mi • M2) = Tr(M2 • Mi) provided that both products are 
well defined. Separating the first two terms in the RHS of (11), we arrive at 

logipg{u) = i^u-u^^l2 + J2^^^^k. |u| < 1/(2||A|U). (12) 

fc=3 

Let us define a = || A||oo/||'^||2- Using simple inequalities, one checks that < '5''^^M2^^ ^'-'^ 
every fc > 3. Therefore, 



f;(2m)Vfc 2^(2HVMi)^ „ 1,2, 91 I- /7^^ 

2^ 7^ <2Mu\ = -2fi2\u\ log(l - 2|u|av^), 



2k 

k=3 



k>0 



for every u satisfying |u| < (2ay^/i2) . This leads to the inequality 

|log^^_,(«/y2;i;) + y| <-z;2log(l-^/2|i;|a), (13) 

for every |d| < (v^a)^^. As a first application of our approach, we obtain a central limit theorem 
for On. 

Proposition 2. Suppose that the matrices A ~ An and E — I]„ as well as the number N ~ Nn 
depend on n G N. //Ai.„, . . . , Xn.u, the eigenvalues ofYl/^AnYl/^, satisfy lim„_^oo ||'^n ||^//^2,Ti ~ 
0, then 

dn — &n D 



^AA(0,1), 



where 0„ = | Ani, On = E[0„] = Tr[I]„A — Tr[(I]„A„)^] and — stands for the 

gence in distribution. 



Proof. Set ^lk,n = Tr[(I]„yl„)'=] = ^Ln ^^d ??„ = {On - On) I ^2^2, «■ The inequality (13) and 
the condition lim„„j.oo |l'^?i||TO/M2,n = imply that the characteristic function of r\n converges 
pointwise to the characteristic function of a standard Gaussian distribution. This completes the 
proof of the proposition. □ 
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This result states that the distribution of the estimator 0„ is well approximated by a Gaussian 
distribution. In order to give a more precise sense to this approximation and to obtain more 
accurate approximations, wc focus our attention on a second-order asymptotic expansion of the 
distribution of On- To this end, wc prove first that the tails of this distribution are sufficiently 
small. 

Lemma 1. If for some p G N the inequality |lAj|^ < /i2/(2p) holds, then for every j G N 



du^ 



< j!(27V||A||^ + \e\y{p/2Y'\i + M2«')-^/^ g 



Proof. Thanks to the fact that Q is distributed according to the Xi distribution, one easily 

checks that |(y9g(u)| = 1 11^1(1 ~ ^iuA^)^-'^/'^! = nfc=i(l + 4u^A^)^"'^/'*. In view of the assumptions 

of the lemma, for every « = 1, . . . ,p, there exists an integer li verifying ^i^^ T^\=i ^\ < ^/P ^"^'^ 

1^2^ Yl^i=i ^1 ^ V-P- For this sequence £i, we get /i^^ Y,i=ei+i ^ + ~ ^/C^P) ^ */P = 
l/(2p) and therefore 



e=i i=i i=ii+i 

This gives the desired estimate in the case where j = 0. 
For j > 0, the explicit form of ipg allows one to check that 



-p/4 



(14) 



ji+---+]N=] "'^ e=i 



1/2 



Simple computations yield 

d^' 



du3^ 
Therefore, 



(1 - 2iuAf)-i/2 



< 



if! (2iA,)^'^ 



< 



j,!||2A|p^ 



(1 - 2iuAfV^+i/2 - (1 + 4.2 A2)i/4- 



d^ 



N 



>^(.) <j\{2N\\X\\^yl[{l+4u'Xl)-^/^ 



and the desired inequality for 9 = follows from (14). For 9 different from zero, it suffices to use 
the relation \ip{^l^{u)\ < J^i^o Cj\i9\''\ip^.^~''\u)\ and the obtained estimate for \(p{^~'''' {u)\. □ 



Remark 2. We will use the result of Lemma 1 in the asymptotic setup described in Proposition 2, 
essentially for bounding the tails of the derivatives of the characteristic function ipg_g(u) of 9 — 9, 
when the absolute value of u is larger than N'^" /y/Jl2 for some go > 0. As we see later, in the 
asymptotic setup, the ratio ||A||^//i2 tends to zero under mild assumptions on the sampling 
schemes. This will allow us to take the parameter p of Lemma 1 large enough to guarantee 
suitable decay properties for the tails of the derivatives of ^§_g- 

3.2.2. Computation of fik in our setup 

We showed in the previous subsection that the asymptotic expansion of the characteristic function 
of 9 involves the traces of integer powers of the matrix S • A. In our setup, both matrices A and 
E have special forms. In particular, they contain only a small number of nonzero entries and, 
therefore, the expression of fi^ takes a simplified form. 

Prior to presenting the formula for fi^, we need a definition. Let fc > be an integer. 
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Definition 1. We call chain of length k, any vector G {1, . . . , A^i}'^ x {1, . . . , A^2}'^ such 

that Pp n J-'p 7^ and J^p n /'p+i 7^ for all p £ {1, . . . , k} with the convention ik+i = ii- The 
set of all chains of length k will he denoted by ■ 

In the definition of '^k, ip (resp. jp) stands for the pth coordinate of i (resp. j). 

Proposition 3. The coefficients ^2 o,nd fi^ can be computed by the formulae 

2 

^ \ - 

1^-2 



3 



(i,j)e%P=i (i,i)e% 
where v,vi and V2 are defined by (4-)- 

Proof. Wc give only the proof of the second formula. The proof of the first formula is analogous 
but simpler, therefore it is omitted. Since ^3 = Tr[(E • A)^], we have 

N 

= E '''^1^2a^2^3'''^3^4a^4^5f''^5^6°^^6fl- (15) 
fl,...,«6 = l 

In our setup, the entries of the matrix A are 

ae^e, = y !{£ < Ni,i' > Ni,l'^r\f-^^ 7^ 0) + i • 1(£ > 7Vi,f < TVi, n J^^^^ ^ 0), 

(16) 

and those of S are 

n J^-^i), if f < iVi,£ > A^i, 
= < wi(/^), if^ = f<iVi, (17) 

0, otherwise. 

To compute the sum in the right hand side of (15), we consider different cases separately. 
Case A: £1 < TVi Our aim now is to compute 

N 

fi<Ni £2, ...,£6 = 1 

This can be done by considering the following four subcases: 

Case A.l £1 ^ £2 and £3 ^ £4, Case A.2 h = £2 and £3 = €4, 
Case A.3 £1 ^ £2 and £3 = £4, Case A.4 £1 = £2 and £3 7^ £i. 

In the case A.l, in order that the corresponding term in (15) be nonzero, the indices £i,i < 6, 
should satisfy £1 < Ni, £2 > Ni, £3 < Ni, £4 > Ni, £5 < Ni and £& > Ni. Moreover, if we set 
* = (^1,^3,^5) and j = (-^2,^4,4), then (i, j) should belong to "^3. Therefore, ai^j^ = v{Pp D J-'") 
for p = 1, 2, 3 and 

1 ^ ■ ■ 

<y£ie2af2£s<^£siia£^ir^a(^^eeai^t^ = G "^3) Y[ ""i^'" <^ J^")- (1^) 

p=i 
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In the case A. 2, in order to get nonzero term in (15), the indices £i,i < 6, should satisfy 
£i ^ £2 < Ni, = > Ni, < Ni and 4 > ^i- Moreover, if we set i = (^1,^5) and 
j — {£3,£e), then should belong to '^^2- Therefore, 

= e '^2)vi{P')v2iJ'')v{n n J^"^). (19) 

In the cases A. 3 and A. 4, it is easily seen that the corresponding summand in the right hand 
side of (15) is 7^ only if £5 — £q. Using the symmetry of aws and (t«'S, we infer that the results 
in these cases are equal and equal to the result of the case A. 2. 

Case B: £1 > Ni We want to evaluate the term 

JV 

ei>Ni £2,...,^6=i 

In view of the symmetry of matrices A and E. we can rewrite 113^3 in the form 

AT 

ei>Ni e2,....ee=i 

Since a^^^g 7^ and £1 > iVi entails £q < Ni, and a^^^g 7^ and £q < Ni entails £1 > iVi, we 

get ^3_B = J2ee<Ni I]£i,£2,...,^5=i '^^6<!5«<!5<!4 0'f4<!3"<?3<?2t^<!2«ia£i<'6- By reordering the indices we get 
^j.3,B = l-ts.A and the assertion of the proposition follows. □ 

Corollary 1. The terms fi2 cind fi^, may alternatively be computed by formulae (5)-(6). 

Proof. Let us prove the second equality. Let us denote by Ti and T2 respectively the first and 
the second sums in the expression of ji^ given in Proposition 3. In this notation, Ajij, = Ti + 3T2. 

On the one hand, (i, j) S "^2 implies that both and have non-empty intersections with 
each of J^^ and J-'^. This obviously implies that ii = 12 or ji = j2- Therefore, 

T2= vi{P')v2{J^')v{P^ n J^') 

= J2 vi{i)v2{J)v{ir\J')Kij+ J2 vi{i)v2{J)v{r n J)Ki.j -J2Mi)y2iJ)v{i n J), 

I, I', J I, J 

the last term resulting from the fact that the terms with ii = 12 and ji — j2 are present both in 
the first and in the second sums of the right hand side. Since the set of intervals 11^ = { J^ } forms 
a partition of [0, T], we have Y.j' '"{I J') = '"i^)- Similarly, J2i' n J) = v{J). Therefore 

T2 = Y,MI>■2{J)[{v{I)+v{J))KIJ-v{If^J)]=v{I\JJ)KIJ. (20) 

LJ 

To compute the term Ti, we decompose the sum i^^o the sum of three terms 

3 

(ij)e<g'3 P=i 

J2 J3}=<? 

If g = 1, then J-'i = J^'^ ~ J^^ :~ J and using the same arguments as for evaluating T2, we 
get Til = J2j'"iJf- If <7 = 2, then ji = j2 ^ js or ji = ^3 ^ j2 or ji ^ j2 = J3. Because of 

imsart-aihp ver. 2010/04/27 file: Dalalyaii_Yoshida_final.tex date: August 3, 2010 



12 



Dalalyan and Yoshida 



the symmetry, it suffices to consider one of tlrcsc cases. Let ji = j2 7^ js and set J = J^^ and 
J' = J^^. The relations G C3 implies that both J and J' have non-empty intersections with 
both and . Therefore, P^ = /'^ := / and setting P- = I' we get 

T12 = 3 ^ u(/ n ,/)«(/' n ,/)«(/ n J') = 3 ^ n j)v{j)v{i n ,/') 
^ 3^v{i n J)v{j)[v{i) -v{ir\J)]. 

L.J 

In the case when all indices ji,j2 and js are different, it is easily seen that G entails 

zi = 22 = is- Therefore, 

Ti3= ^ t>(/n J)w(/n JOi'l/n J") 
I, J, J', J" 

#{JJ'J"}=3 

= v{inJ)v{inJ')[v{i)-v{ir\J')-v{ir\J)] 
= w(/n J)w(/n J')w(/) - 2 ^ i;(/n J)2'y(/n J'). 

Using the identity Y.j,,j^j,v{I n J') = - v{I n J) we get T13 = ^ J2i,.j^'il 

J)^[3w(/) — 2w(/ n J)]. Summing up the terms Tn, ri2, T1.3 and r2 we get equality (6). Equality 
(5) can be proved along the same lines. □ 

Remark 3. If the observations are synchronous, that is 11^ = 11^ = 11, then fi2 and ^3 have the 
following simple expressions: 

2/^2 = Y [^(^)' + Ml>2il)], V3 = ["(^)' + 31^1 (/)^^2 (/)«(/)]. 

/en /en 

Lemma 2. Assume that we are given two sequences of partitions 11^ = < A^i.n} and 

— {J^nj !i -^2.n} 0/ the interval [0,T]. Define the matrices An and I]„ fty (16) and (17). If 
the functions ai and are bounded on [0,T] by some constant a, then 

maxA2„ = |l(I]y2^„S,V2)2|| < 3^4^2^ 
where r„ = [(max^ |/,^|) V (maxj | J^^l)]. 

Proof. Let us define a new partition as follows: / € IlJ, if and only if either / G 11^ and it 
has non-empty intersection with two distinct intervals from 11^ or there is J G 11^ such that / 
is the union of all intervals from 11^ included in J. The partition 11^ is defined analogously. It 
is easy to check that the estimator 6'„ based on (11^,11^) is equal to the one based on (n^,n^J. 
It follows that fip^n = ij-p,n for every p G N. Therefore, the relation max^ n ~ li™p^cx) M2p^n 
implies that max^ Xj „ = max^ ^'e n- clear that r„ = f„ , but the advantage of working with 

{ni,nl) is that 

max V Kij < 3, max V Kjj < 3. (21) 

jen^ ^ /efii ^ 

/eni Jens 

In the remaining of this proof, without loss of generality we assume that (21) is fulfilled for 
partitions (11^,11^). The estimate || (Ey^A^Ey^)^!! < ||I]„|p||A„|p implies that it suffices to 
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estimate ||A„|| and ||Sn||- To bound from above ||A„|p, we use ||j4„|P ~ max„.|„|^i l^n^P and 



2 -, / X 2 

j 

Applying the Cauehy-Schwarz inequality and changing the order of summation, we get the in- 
equalities J2i ( ^/VJ UN^+j) < I J2j '^Ni+j and ( T,z Kpji Ui) < I '^h which imply 
that ||A„||2 < 3/4. 
On the other hand, 

N N 

llSnll = max aej/uiUi' = max ( (t^,^u^ + 2 n J^juiUAr^+j 

' ij' = l ' ' f=l i,j 

Since ai^i'S are given by (17), the first sum in the right hand side is bounded by (T^(maxi |/^|) V 
(maxj I J^l), whereas the second sum can be bounded using the inequality relating the geometrical 
and the arithmetical means : 

<Y,viP„nJi)u^ + Y,v{ii,nJi) 

i,i i,j id 

= E^(^")"^ + E^('^")"^i+j 

i j 

<|«|V(max|/;|)V(max|J^|). 
This completes the proof of the lemma. □ 

As a by-product of the preceding lemma, we give below a simple sufficient condition for the 
asymptotic normality of 0„. 

Corollary 2. In the notation of Lemma 2, if 

lim ^ = 0, (22) 

n-s-oo ^2,n 

then [On — 6) / ^J2^2,n converges in distribution to a standard Gaussian random variable. 

Proof. According to Proposition 2, it is enough to show that lim„^oo Tr[(s \ ")^)] ~ This 
convergence follows from assumption (22) and Lemma 2. □ 



3.2.3. Expansion of the characteristic function for random sampling schemes 
We assume now that the partitions 11^ and II^j are random and independent of {Xi^t — Xi^, X2d — 
^2,o}t6[o,T]- We denote by E'^ the conditional expectation given n„, where n„ = (n^j,n^j). 
Since in this setup the quantities r„ and ^2,n — introduced in Lemma 2 and in Proposition 2. 
respectively — are random. Corollary 2 can not be applied directly. The following result gives 
a sufficient condition for the convergence in distribution of Corollary 2 to hold in the setup of 
random sampling scheme. 

Proposition 4. Let rn be defined as in Lemma 2. If r'^/ ^2,n tends to zero in probability as 
n — >■ oo, then (0„ — ^n)/ converges in distribution to a standard normal random variable. 

If moreover, 2^2,n/bn > c for some deterministic sequence {b„} and some positive constant 

c, then {On - e)/y/b7, — ^ iV(0, c). 
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Proof. Denote crp] = crpn, n e N]. Our aim is to show that for every u e M the conver 
gence E 



exp \ iu(9n — On) / ^J2^2,nj > E[e 2" ] holds. Let us denote a„ = E cxp yiu{6n — 

Qn) I \J'^P'2.n^ and a = E[e^^" ]. To show the desired convergence, it suffices to check that ev- 
ery convergent subsequence of {a„} converges to a. For checking this property, one can simply 
remark that for any subsequence {a„^}, there is a sub-subsequence {ukA such that /a*2 
converges almost surely. Then, Corollary 2 implies that an^.. converges to a as j — >■ 00. Therefore, 
a is also the limit of the sequence {a„^} and the first assertion of the proposition follows. The 
second assertion follows from the first one by a simple application of the Slutsky lemma. □ 

From now on, we assume that the assumptions of Proposition 4 are fulfilled and aim at finding 
the asymptotic expansion of the distribution of the random variable <Y„ = (0„ ~ &)/ V^n as 
n — > cx) . The first step in deriving the asymptotic expansion of a distribution is the expansion of 
the characteristic function. As usual, the desired expansion involves the r-th conditional cumulant 
of Xn given 11, henceforth denoted by Kr [Xn] . Let Ar,n be the normalized r-th conditional cumulant 

K,n = b-'^KriXn] = 2'-l(r - 1)! 5;'^+Vr,n. 

Note that this notation is consistent with those introduced in (7). 
Lemma 3. For every positive integer r, we have 

l^r.nl < X! l-^'^.^r - max|A^|''"^^2,n < (q;„ V^)''"^M2,n , (23) 

where q:„ = ^/?ia'^rnhn^^^ . In terms of the conditional cumulants, this is equivalent to \Kr[Xn\\ < 
CrCkJ^"^ \2,n, where = 2''^^(r — 1)!. 

Proof. This is an immediate consequence of Lemma 2. □ 

Proposition 5. Let the sequence {bn\ he as in Proposition ^. For some fixed Ci > 0, let 

T'nlfS) = {n : a„ < ,5, A2,„ < ci}, V(5 > 0. 
Then, for every j G , there exist some positive constants C and q such that 

du^ 



for every u satisfying \u\ < C5 and for every n„ € Vn{5). In this formula, 0(6^) stands 
for a random variable depending only on partitions n„ = (n^,n^) and satisfying the condition 
limsupi-^oSup„supn,^g-p„(i) \0{dP)\6-P < oo. 

Proof. Let us define ao{u) = -A2,„mV2, ai,„(u) = ^'"^ and r„(u) = J2T=4 ^^zlfc"^^'" " 

Using (11) and the fact that in our setup max£ jA^j is bounded by \/3cr^r„, we get 

En[e'"^"] = exp ( V = exp ( - + 1^!^!!^^^ + r„(u) 



2fc&^/' J I 2 ' 6 

for every u e M such that |w| < 1/(2(5). One easily checks that 

En[e'"'^"]-e°"(")(l + ai,„(w)) = e'^°(")(ai,„(w) + r„(w))2 f f i;e*''(''i'" dW?; 

+ r„(u)e°"("). (24) 
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Inequalities (23) imply that there exists some constant C > such that for every i < j and for 
every n„ G Vn{5). it holds that 



< C 



(1 + u'^)aln2,n 

bn 



as soon as < l/(4a„). Similarly, for every £ eN, 



ai,„M < C2(i + \u\')^^^ < C2(i + \u\')6, if n„ e r„ 

These inequalities in conjunction with Eq. (24) yield the estimate 



_(P_ 

du3 



(En[e'"-^"] - e'^"(")(l + «i,n("))) = 0{S^)il + lu^e 



This completes the proof of the proposition 



□ 



Remark 4. As usual in asymptotic expansions, the coefficient of the second order term (i.e., the 
coefficient of {m)''^bl/'^) in the obtained decomposition is given by the normalized third cumulant 
divided by 6. It also admits the following representations: 



1 



where fx^^n is defined by (6). 
3.3. Proof of Theorem 1 

Let us start by proving relation (8). Let h(a;) = 1 + Let /C be a probability density on 
M such that the Fourier transform Xi of /C is compactly supported, \x\'^^'^}C{x) dx < go and 

J^^)C{x)dx > 2/3. Let K > 0. For e > 0, define the measure K.^ by ICf_{x) = /C(e~^x) for all 
a; G M. Using the modified version of the Sweeting lemma [42] stated in Babu and Singh [4, 
Lemma 1], wc get: 

|En[/(A'„)] < 9^M(P^'-|n + |vI/n|)[h](Ao + Ai+A2)+A3, 

where 



(25) 



0= / h(a;)|/C,,K * (P^-in - «'n)|(dx), Ai = 6^ / \x\'^+^ICix) dx, A2 ^ 
JR " Jm. 



-K/A 



A,= sup / u;fix-y,2b^)\^^\{dy). 

\x\<b^ JR 

As we already mentioned, the Rosenthal inequality yields that P'*"l'^[h] = 1 + E'^[|A'„|'''] is 
bounded uniformly in n. Furthermore, it is obvious that the term |^'5J|[h] is bounded uniformly 
in n. 

If n is sufficiently large, [x — y — 26^, x — y + 2b^] C [—y — ibn^^, —y + 3bn^^] and therefore 
A3 < 2 / ujf{-y,3b^/')\^ll\{dy) < C° / ujf{y,3b^/^)q^{y-c*)dy < Cfof'^^ 



du. 



On the other hand, Aq admits the estimate 
2+7 



a=0 
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where ip^ [u) = E'^[e'"'^"]. Let 5n — h°n'^^'^ . By virtue of Proposition 5 and Lemma 1, we have 



9° 



du 



< 



|u|<C<5„ 



m:|«|>Ci5, 



-1/3 



du 



< 



u:\u\<CS, 



-1/3 



C2 



■.\u\>C5-^^^ 1 + l"P 



du 



2+7 

E 



where L can be chosen as large as we need, therefore Aq < CsS^. Combining all these estimates, 
we get 

Choosing K > max(2a — l,4(2a— 1)/?/), we got the relation stated in (8). 



To prove (9), we notice that |A3,„(A2,n — c)| = 0(6„ ^r,i x bn ^^^) = 0(6n" ^ ) = o(l) miiformly 
on the event A„. Expanding A2,n) in 5*5^ around c we get the desired result. 



, 2a- 



4. Poisson sampling scheme 



As an application of previous results let us consider the case when the partitions and are 
generated by Poisson point processes. Let = {^l'",t > 0), i — 1,2, be two independent 

homogeneous Poisson processes with intensities npi^ i — 1,2. Moreover, assume that these pro- 
cesses are independent of B. Let the sampling times S^, . . . , S^'^ and T^, . . . , T^^ be the time 
instants corresponding to the jumps of ^^-^ and ^^.n occurred before the instant T. Note that 
S^s and T^s depend also on n. However, for simplicity of exposition this dependence will not be 
reflected in our notation. 

Prior to stating the main result of this section, let us recall several notation. We denote by 
h(t) the function <7i_t<J2.tPt and by x-\. the positive part of a real x. Finally, we write 171(2) cx 52(2) 
if for some Cg £ R the equality gi{z) = Cgg2{z) holds for every z. 

Theorem 3. Let the sampling scheme be generated by two independent Poisson processes with 
intensities npi and np2, independent of the driving BM B. If the functions ai, (72 o,iT-d p are 
Lipschitz continuous then, for every a G (|, 1), holds that 



sup 

/G£:(A/,7)n£0(C,r,,ro,c*) 



where 



E[/(V^(0„ - 0))] - / f{z)pl{z)dz 
2k{z^ - 3cz) 



(26) 



/n 



is a probability density with 



\Pl P2/ Jo P1+P2 Jo 



-z'/{2c) 



{(Ti,tcr2,tPtfdt, 



,2 rT 



r hitfdt+M±^^qEi±M 

\Pi P2J Jo P1P2 Ja 



Jo 
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Before proceeding with the proof of this theorem, let us note that it extends the asymptotie 
normality result proved in Hayashi and Yoshida [19], providing the seeond-order term in the 
asymptotic expansion of the distribution of Note however that the price to pay for getting 
this expansion is a slightly stronger assumption on the functions cti, (T2 and p. Indeed, we assume 
in Theorem 3 that these functions are Lipschitz, while in [19] only the continuity of these functions 
was required. 

Remark also that the constant of proportionality in the definition of p° can be replaced by 
one. Indeed, Pniz) is the positive part of the function 



1 

Z 



2k(z^ - 3cz) 
1 + ^ ^ . — - 



7(2c) 



(27) 



whose integral over M is equal to one. Moreover, for some c > 0, the function (27) is positive 
on the interval [— cn^/^, cn^^^] and its absolute value is bounded by an exponentially decreasing 
function outside the interval [—cn^^^,cn^^^]. This implies that the proportionality constant in 
the definition of p° is 1 + 0(e~"^ ^/(4c)) and, consequently, its exact value is unimportant. 

Proof of Theorem 3. We want to apply Theorem 2. To this end, we have to accomplish the 
following tasks: 

[Tl] prove that A2,n — 2np,2,n is very close to c in expectation and in probability, 

[T2] check that the maximal sampling step r„ is smaller than 6° with high probability, 

[T3] determine the asymptotic behavior of E[A3^„], 

with b„ ~ 1/n and some a < 1. In fact, we will show that any a < 1 can be used. 

Concerning the task [Tl], it is proved in [19] that 2nfi2.n converges in probability to c. In the 
present work, we need a result providing the rate of convergence of 2nfi2,n to c. It is done in the 
following 

Proposition 6. // the functions ai, a-i and p are Lipschitz continuous, then there exists a 
constant C > 2 depending only on pi and p2 such that, for every x > C log n and for every 
n > 2, it holds that 

+ < Cne-^/c, 



/n 



P \2np2,n - c| > ^ + ^ < Cne""/^ . (28) 



Furthermore, E[2nfj.2.n] = c + ©(ji ^ log^ n) as n goes to infinity. 
The proof of this proposition is deferred to Section 7. 

The task [T2], consisting in bounding the probability of the event r„ > bf^ = n^'^ is done using 
the following lemma. 

Lemma 4. There exists a constant C depending only on pi and p2 such that, for every x > 0, 
the inequality P(nr„ > x) < Cne~^^'~^ holds. 

Proof. We start with bounding P(max/gni '^l-^l > 2;). According to the Markov inequality, for 
every u > 0, 

P(maxn|/| > a;) < e~"^E[ ^ e""l-^l . 

The last sum can be bounded by the sum of A^i independent random variables each of which 
has the same law as e"''/^^, with C, being exponentially distributed with mean 1. In view of the 
Wald equation, this yields E[^^gj-[i e""'^'] = npiT'E,[e^'^/P^]. Choosing u smaller than pi and 
repeating the same arguments for maxj^n^ n],]], we obtain the desired result. □ 
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Replacing x by ri^~° in (28) and by n^~" in Lemma 4, we obtain that the probabihty of the 
event An{aY is exponentially small as n oo. Therefore, P(^„(a)'^) = o{h^) = o(n~^) for every 
p > 0. One also deduces from Proposition 6 that E[A2,ri] — c = 0(71^^^") as n — )- 00. Thus, it 
remains to accomplish the task [T3], which is done using the following proposition, the proof of 
this proposition is deferred to Section 7. 

Proposition 7. Under the assumptions of Theorem 3, it holds that E[/i3 „] ~ |Kn~^ + 0( '°^3" ). 
Combining these results, we get the assertion of Theorem 3. □ 

5. Stochastic decomposition for 0„ in a model v^fith drift terms 

So far we have considered a Gaussian system {Xn — Xi_0j^2,t — -^^2.0) the underlying model 
and essentially finite dimensional Gaussian calculus served as a tool. In this section, we will treat 
a system that has random drift terms. It will be seen that the principal part of the estimator 
is the same as in the case without drifts. Thus, the contribution of the principal part to the 
asymptotic expansion of the estimator has already been assessed in the previous section. 

Beyond being a useful tool for deriving asymptotic expansions of the distribution of 0„, the 
stochastic decomposition of the HY-estimator that we obtain below bridges the problem of esti- 
mating the covariance and that of signal detection in Gaussian white noise. The latter problem 
has been extensively studied in the statistical literature and we believe that the methodology 
developed for the problem of signal detection may be of interest for our problem. 

To state the main result of this section, let us recall that we deal with processes Xi and X2 
given by 

dXi^t= Pi,tdt + ai^tdBi^t. ie[0,T], 
dX2,t = P2,t dt + U2.t dB^.t, t € [0, T], 

where fii^t are progressively measurable processes and assumed to be unknown to the observer. 
We will assume that these drift processes admit the following stochastic decompositions: 

= + /3j}|, + dS2,t, ^ = 1, 2, 

where /3|°', i,j = 1,2 are progressively measurable processes with respect to the filtration 
{a{Bs, s < i)}te[o,T]- 

In this section, we will separate the assumptions on the sampling scheme from those on p 
and on the drifts and volatilities of Xi and X2- For this reason, let us introduce the following 
measures on ([0, T]^, ^[o.t]^): 

Hi(-) = b-'\ • n{u,/ X /}|, v;ii-) = b-'\ ■ n {UjJ x j}|, 
vr'(-) = fc,T'|-nM„;(/nJ)x(/nJ)}|, 

I.J 

Note that these measures depend on the sampling schemes and, therefore, they are random 
if the sampling schemes are random. Similarly, let V^'^''^(-) = • n{UjJ x /(J) x /(J)}|, 
Vy'^'(-) = b~^\ ■ n{U// x J{I) X J(/)}| and yJJiynJ):J^i ^ . n{U/,j J(/) x I{J) x Jn/}| 
be (random) measures defined on ([0, T]"^, ^[o,t]3)- 

Assumption PI The random measures V^, V^, ^i'^'^ and V^'"' converge weakly to some deter- 
ministic measures V^, V"^ , V^^'^ and V^'"' in probability, as rt — > 00. These measures are 
concentrated on the diagonal = {{s,t) e [0,r]^ : s = t} and absolutely continuous 
w.r.t. the Lebesgue measure on the line. 
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Assumption P2 As n oo, the random measures V^'^''^, V^'-'''^ and v;('^)'^'"')'^'^'^ converge 
weakly to some deterministic measures V^-^''\ yi^J,-^ and V'^'-'^''''^'''^''''^'^"' in probability. These 
measures are concentrated on the diagonal 1?^ = {(s,i,u) S [0,T]'^ : s = t = u] and 
absolutely continuous w.r.t. the Lebesgue measure on the line. 

The weak convergence of V,{ to in probability should be understood as follows: for every 
continuous function (y9 : [0, T]^ — > M, the sequence of random variables /jp V'dV^ converges in 
probability to Jjg j,^^ fdV^ as n tends to infinity. For the purposes of the present work, it is prob- 
ably possible to slightly relax Assumption P2 by replacing the weak convergence by the tightness 
condition. However, to avoid additional technicalities we assume that the weak convergence of 
measures stated in Assumption P2 holds. 

Recall that according to our assumptions 11 is independent of B, where 11 is the collection of 
random intervals P := [S'-'^ AT,S' A T], ~ (T^-^ A T, A T] with i = 1, . . . , A^i and j = 
1, . . . , N2. In what follows, the following notation will be used: for two functions /, g : [0, T] R, 
we denote by f ■ g the function 1 1— >■ fg dgs and we often write I or J instead of 1/ or Ij. Thus 
the estimator 0„ can be rewritten as 

Ni N2 
i=l j = l 

We want to derive an asymptotic expansion of the distribution of this estimator using a pertur- 
bation method based on a stochastic expansion of the estimator 9n itself. The main term in this 
stochastic expansion is 

Note that the asymptotic expansion of the distribution of has already been obtained in 
preceding sections. In this section, we will need a representation of M" as a stochastic integral 
with respect to the BM {Bi, B2) that can be written — using the Ito formula — as follows: 

M" = H1^"-Bi+H2^".B2, (29) 

where H^'" = Y.ubn^'^ Kij{J<^2 ■ B2)I<Ji and tf-" = J2lj bn^^^ Kij{Iai ■ Bi)Ja2. 

Lemma 5. Assume that 0\,a2 and p are bounded and /sfj ^Ks are bounded in uniformly in 
[0,T] for every i,j,ee {1,2}. If r^ = Opibl), then 

b-''\k -e)= + b]!^{N^ + + 0^(61/2), 

where dNJ^ = '"di?i.t + Gj'"c?-B2,t is a local martingale with 

G^'" = b-' K^Mi'Pi) ■ t)iJ'<^2)} + b-' Y K^dis' - s'-' V •)+ 

hi i,j 

and A" is a bounded variation process defined by 

A- = b-' Y iU,[j'{[i'^i{P''2l + 42V)] • 4 + r'{[^V2(M\'p + M2')] ■s}}-t 

hi 
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Lemma 5 provides a stoehastic decomposition of the HY-cstimator with a RHS depending on 
n. Under the assumptions PI and P2 of the convergence of random measures associated to the 
samphng scheme, it is possible to obtain a refinement of this resuh with a RHS depending on n 
exclusively through 6„. To this end, limit theorems for martingales will be used. An important 
step for proving limit theorems for martingales is the computation of the limits of their quadratic 
variations and covariations, which will be treated below. 

5.1. Convergence of quadratic variations and covariations 

— 1/2 ^ 

To establish an asymptotic expansion of 6„ {On — 0) that is more explicit than the one given by 
Lemma 5, we need to identify the limiting distribution of the martingale {Bi, B2, M"^, N") as n 
goes to infinity. The convergence of the quadratic variation-matrix is a classical tool for proving 
the convergence of a martingale. Most results of the present section being quite technical, we 
postponed their proofs to Section 8. 

We start with the cross terms (A/", Bi) and (A/", B2). In view of (29), for j/ = 1, 2, we have 



(Af",B,) =Hi'" • {Bi,B,) 



{B2.B, 



^ b-^^^Kjj \{{Ja2 ■ B2)M} • {Bi,B,) + {{lai ■ Bi) Jas} • (B2, 



I,. J 



Lemma 6. If (ii, 02 and p are bounded in [0,T] and = Op{bn), then 



sup 

!^=l,2 



sup 
1^=1.2 



Y,b-'^'Kij{{{J<J2 ■ i?2)M} • (i?i,B.))^ 
Y,Ky'Kjj{{{Ia, ■ B,)Ja2} ■ (i?2,B.», 



^0, 



^0, 



for every t € [0,r]. As a consequence, for every t £ [0,T], maxi,=i^2 \ , B^)t\ tends to zero in 
probability as n —> 00. 



We study now the behavior of the quadratic variation 
2 

{M",M")t = J2 • {Bc,Bd)t 

c,d=l 

as n tends to infinity. First, we note that 

]jji,„jjj2,„ ^ ^ b-^K,jK,,j,{J^a2-B2)PaiiP'ai-Bi)J''a2 



(30) 



= K,jK^^ J. {J^ (72 ■ B2) J'' a2l{j<f }{r' ai ■ Bi)r ail 

Denote by R'^{i,i',j.,j') the summand on the right-hand side of the last equation. This term is 
different from zero only if the conditions P D ^ 0, n J^' ^ 0, P' .P' ^ 0, j < f and 
i' < i are fulfilled. If i' < i, then these conditions are fulfilled only if j = j'. Similarly, the terms 
with j < j' are non-zero only if i ~ i' . This leads to 

jji,„jjj2,„ ^ J2 b-^K,,K,y{.Pa2 ■ B2)Pcj2{Pai ■ Bi)Iai 

iJJ'- 3<j' 

+ K^K,jK,,j{,Pa2 ■ B2)P (T2{P' (Ti ■ Bi)Pai 

- Y bn'K,3{J'<^2 ■ B2)Pa2{Pai ■ Bi)Pai. 
i,j 
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Sum them up in j' and in i respectively and use 

j'- j<j' 

{P'ai ■ Bi)J KrjP = (Pai ■ Bi)Jl[s^-i^T] = (P ^^i ■ Bi)J. 

i: i' <i 

to obtain H1^"H2>" = J^i.j cri<^2Kij{Ja2 ■ B2){I(Ji ■ + J - IJ). This imphes that 



i,B2)t= f ai,sa2,sY.Kl{s){Ja2-B2)s{Iai-Bi),d{BuB2)s, 
•^0 U 



where kl{t) = b~^Kij{It + Jt ~ hJt)- 

Lemma 7. Assume that rj^ = Op{b'^) and the functions ui, 02 and p are continuous. If Assump- 
tion PI is fulfilled then, for any t G [0,r], 

p 1 



[\Ml'-fd{B,,B,)s+ [\mln'd{B2,B2)s~^ f <s<sV'''{ds) 
Jo Jo Jo 



anrf consequently 



(M», A/")t /* /i^ {yi^ds) + V'ids) - V^n'^(ds)} + r a? 4. "^"('^s)- 



"'0 



Using the claims of two last lemmas, one can already derive the asymptotic distribution of 
the martingale (_Bi, i?2, Af") as n — > 00. However, for our purposes, it is crucial to know the 
asymptotics of the joint distribution of the triplet {Bi, B2, A/") with the martingale N"". 

Lemma 8. If o'i,(J2 and p are bounded, supj^jQ E[/3?f] < 00, i = 1,2 and rf^ ~ Op(^n) 
n — ^ 00, then for any t £ [0, T] the sequence of random variables (A'/", -/V")t tends in probability 
to zero as n tends to infinity. 

An interesting fact revealed by this lemma is the orthogonality of A/" and iV" in terms of 
quadratic covariation. This indicates that the limiting distribution of {M",N") is that of two 
independent martingales. This statement will be rigorously proved at the end of this section. 
Prior to presenting that proof, we wish to investigate the structure of the limiting distribution of 
A^" and how it relates to the BM B. 

Lemma 9. As.sume that rf^ ~ Op{bf-^) and that sup^g^ -7-] E[(/3|^'J'^')2] < 00 for every i,j, i € {1, 2}. 
Then, under Assumption PI, for every fixed t S [0,T], we have 

pt 

{N'',Bi)t~^ / {P2,s(Tl,s+Pl,sa2,sPs)V'-'''{ds), 



n— >oo 







(A",S2)f-^ / {Pi,sCr2,s + P2,sai,sPs)V'-'{ds) 



n— >oo 







This lemma describes the parts of the limit of A^" that can be described or explained by Bi 
and B2. This is however not enough. One also needs to evaluate the limiting quadratic variation 
of the process A^". 

Lemma 10. If Assumption P2 is fulfilled, then for every t e [0,T], we have 

(Ar»,iV")t-^ f PlaldV'^'-'' + f plaldV'''' + 2 f /32l3i'Ji<y2pdV'^'^-^^'^''''' . 
Jo Jo Jo 
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The last step before stating the main result on the convergence of the processes involved in the 
stochastic decomposition presented in Lemma 5 is the proof of the convergence of the bounded 
variation process A". Recall that the latter is defined by 

/,,/ 

+ 5,-1^ Ku{{iPi)-t}x{{Jh)-t}. 
I,.] 

Obviously, it can be written as A" ~ A]'" + A^'", where 

= J2 I I {<^l.Mlu + 42,uPn) + <^2Al3^llsPs + M2..J }!{«<.<*} duds 

I, J 



iJj J[o,t 



Using Assumption PI and the fact that the measures V^"^ are concentrated on the diagonal of 
the square [0,^]^ we get = + Op(l) with 

Ar = \ ^ Vi,«(4\',„ + P^2luPu) + ^2,uW^lluPu + Ms'.u) + '^PuuhujV'^'idu). (31) 

Proposition 8. Assume that the functions ui, 02 ond p are continuous in [0,T] and that 
supjg[Q E[(/3j^ ^')^] < 00 for every i,j,£ G {1,2}. // assumptions P and PI are fulfilled, 
then the sequence of two dimensional processes {M'^,N'^ + A") converges weakly to a process 
(M°°,7V"°° + ^°°). Furthermore, + A°° is independent of M"^ . 

Proof. We already did the major part of the proof by showing the convergence in probability 
of the sequences of quadratic variations-covariations and that of A". Now, if we apply Theorem 
2-1 from [23] to the semimartingale Z" = {M^\N" + A")"^ with B serving as a martingale 
of reference (denoted by M" in [23]), we obtain the weak convergence of to a process Z. 
Moreover, it follows from (ii) of the aforementioned theorem that Z may be constructed on 
an enlargement of the original probability space on which there is a two-dimensional Brownian 
motion B independent of B such that 



where 



2 ,2(dV' dV' dV'"^'' -I 2 2 dV^''^ 



I ds ds ds i ^'^ ^'^ ds 

stands for the Radon-Nikodym derivative of liuin^oo {M" , M''^)t with respect to the Lebesgue 
measure (cf. Lemma 7) and Ws is a predictable process (hence independent of B). If we denote 
(M°°, iV°°) = - (0, A°°), we get M,°° ^ J* dBi,, and ^ m,, dSi,, + /J na,. dB2,s + 
Jq tDi.s dB2.s with a predictable process rig ~ (ui, 1x2), and the assertion of the proposition follows. 

□ 

This result implies in particular that E[7Vj°° + A^\M^] = E[iVf° -|- Aj°°] = E[^f=] for every 
t G [0,r]. Therefore, using (31), we get 

A = E[N^ + A^\M^] 

= i ^'^{ai,„E(/3W „ + /3W„p„) + a2,„E(/3W „p„ -f Z?™, J + 2E[/3i.„/32,u]}V^^-^(dii). 
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As we sec in the next section, this expression of A appears in the asymptotic expansion of the 
distribution function of 6„ (0„ — 6). 

6. Expansion of the distribution for a model with drift terms 

The aim of this section is to obtain an asymptotic expansion for the distribution of the HY- 
estimator in the case where the diffusions Xi and X2 have non-zero drifts. As shows the stochastic 
expansion of 9n obtained in Lemma 5, the main term in the expansion of bn {On — 0) is inde- 
pendent of the drifts. Therefore, asymptotic expansions for its distribution are aheady obtained 
in Sections 3 and 4. This indicates that the influence of the drifts on the distribution of 9n can 
be regarded as a small perturbation of the distribution in the case where there is no drift. Before 
stating the main result of this section, let us give a theorem that allows to derive the second-order 
expansion of the distribution of a random variable defined on the Wiener space in presence of a 
random perturbation. 

6.1. Perturbation 

Since the drift terms are possibly non-linear functionals of the Brownian motion B, we need the 
Malliavin calculus to carry out computations on the infinite-dimensional Gaussian space. 

The basis of our arguments is a perturbation method for deriving asymptotic expansion. It 
was used in [45] for the perturbation of a martingale but the proof was written inseparably from 
the martingale structure. In order to apply this methodology to the present situation, we will 
begin with generalizing Theorem 2.1 of Sakamoto and Yoshida [38]. 

We consider a probability space equipped with a differential calculus in Malliavin's sense, an 
integration- by-parts formula and the Sobolev spaces fip^e equipped with the norm || • \\p^e- For 
positive numbers M and 7, let f(Af, 7) be the set of all measurable functions f : ^ M. 
satisfying |/(a;)| < M(l + for aU x € R'^. Let £' be a subset of f (M,7). 

Let Xn and 3^„ be M'^-valued Wiener functionals and put 

^n X^ -\- .Sn^n 

for some sequence of positive numbers s„ tending to as n — > 00. We write Gnif) = o(s„) if 
fi-i supf^£ |G„(/)| ^ as n 00. 

Theorem 4. Let £ be an integer such that £ > d+2. Suppose that the following conditions are 
satisfied: 

(1) sup„ ||A'„||p,£ -I- sup„ ||3^n||p,f < 00 for any p> I, 

(2) (A'„,3^„) ^ (<^oo,3^oo) for some random variables Xoo and y^o. 
In addition, assume that there exists a functional Tn such that 

(3) sup„ ||T„||p,f_i < 00 for any p> I. 

(4) P[|r„| > 1/2] = o(s°) for some a>l. 

(5) sup„E[l{|^„|<i}(detcrA'„)"P] < 00 for any p > 1. 

( 6) There is a sequence of signed measures on Md such that for any positive numbers M and 
7, E[/(A'„)] = ^n[/] + o(s„) as n —> 00 for f G £' . Moreover, for every polynomial t:{x) in 
X, there exists a constant c-^ such that |\I'„[e™'^7r(x)]| < c^{l + for all u G . 

Then X^o has a density p'^°° with respect to the Lebesgue measure and, for any positive numbers 
M and 7, 

E[/(Z„)] = *„[/] + s„ / /(x)5oo(x) dx + o(s„) (32) 
for f G £' , where goo{x) = -div^; (E[>'oo | Xoo = x\p-^°°{x)). 
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6.2. Asymptotic expansion of the distribution 

We are now in a position to state and to prove the main result of this section, which provides an 
unconditional asymptotic expansion of the distribution of the HY-estimator. It is also possible to 
derive asymptotic expansions conditionally to the processes generating the sampling times, but 
they have more complicated form and are not presented here. 

Theorem 5. Suppose that Assumptions PI and P2 are satisfied and 

sup ^' |jp_4 < oo, for all p>\ and i,/G{l,2}. 

te[o,T] 



Let us define 



c = 



<^lA,t^"^d^) + I <^l,t<T2,tPt{V\dt) + V\dt) - V'^^^dt)], 



A = ^ y {^i,nE(/3W „ + + a2,„E(/3i\l „p„ + Z?™ n) + 2E[/3i,„/32,„]}V^^^(du). 

Under the notation of Theorem 1, if for some a £ (3/4, 1), P(A„(a)^) ~ o(&fJ for every p > 1, 
and E[2^2,n - c] = ©(fo^^-i), then 



sup 

/G£(j\/,7)n£0(C,r,,ro,c*) 



nUK'^HOn-O))]- / f{z)p*Jz)dz 



o{b'J'), (33) 



where 



/27rc 



1/2 



pI{z) = ^ l + -^(E[A3,„](z'-3cz) + 6Ac^z 



Moreover, i/ sup^gp^ E[A3.„] < 00, then inequality (33) holds with p'^ replaced by 



+ (^\ _ max(0,p;(z)) 



4max(0,p;(w))(iu ' 
which is a probability density. 

Proof. Wc apply Theorem 4 to Z„ = bn^^'^iOn - 0) with £ = 4, = and 3^„ = bn^'^{Zn - 
M^). Thus, we need to check that all the 6 conditions of Theorem 4 are fulfilled. In view of 
Lemma 5 and Proposition 8, 3^„) converges in distribution to some random vector (A'oo, 3^oo)- 
Thus the second condition of Theorem 4 is verified. 

Wc have already seen in Section 3.2.1 that the principal part Xn of hn {On — 0) can be written 
in the form <Y„ = bn^'^{i^Ai -6) = bn^'^ Efci ^«,"(CL - 1), where 

^ = ({/Vi • BJt, . . . , {/"^^ai • Bi}t, { JV2 • S2}t, . . . , { J'^V2 • B2}t, - AAw(0, S) 

and the entries of the matrices E and A are given by (17) and (16) respectively. Recall that the 
vector ^ e is obtained as a linear transformation of ^ and is distributed according to A/'(0, /). 

Let W = Co([0, T], R^) be the Wiener space of continuous functions from [0, T] to vanishing 
at the origin. Recall that W is a measurable space equipped with the Borcl cr-field induced by 
the uniform topology. The reference measure on W is the measure generated by the standard 
Wiener process (in our case, the two-dimensional Brownian motion). 

Let w = {wi,W2) be the canonical process on W. Then, [81,82) can be defined by 

Bl.t=Wi^t, B2,t= / PsdWi^s+ / Vl - dW2,s- 

Jo Jo 
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Obviously, for every £ = 1,...,N, there is some function (j)^ e L^([0,r],R^) such that Q^n = 

lo ^it dwi,t + /(f 02,t dw2,t ■■= w{(l)'^). 

The process w is an isonornial Gaussian process on iJ = L^([0,T],]R^) (see [32, Def. l-l-l]) 
Using the definition of the MaUiavin derivative (see [32, Def. 1-2.1]) and the chain rule [32, Prop. 
1.2.3], we get the following expression for the MaUiavin derivative of 

N 

e=i 

Since the components of C £^re non-correlated with variance equal to one, the family {(j)^}e<N 
is orthonormal. As a first consequence of this fact, we get that sup„ ||A'„||p.4 < oo for every 
p > 1. To show this, Rosenthal's inequality and the result of Lemma 3 can be used. As a second 
consequence, we obtain that the MaUiavin covariance of Xn is 

n n 
<^X. = ^K' E ^InCln = 46- V2,n + 46"! ^ ^IniCL " !)■ (34) 

e=i 1=1 
Let us introduce the random variable t„ that will play a role of truncation: 

N 

r„ = -(2 - 8Ai2,„(c6„)-^)+ + 8(c6„)-i ^ ^L(C|,„ - !)• 

In this notation, we have ax^ > c+ ^f- and, therefore, l||T-^|<i}|cr_^^| < 2/c. Thus, the condition 
(5) of Theorem 4 is obviously fulfilled. Let us check now that t„ satisfies conditions (3) and (4) 
of the aforementioned theorem. 

To verify condition (3) of Theorem 4, we remark that 

N N 

Dt„ = 16{cb„y' E nC£,n0', D^r„ = 16(c6„)-i ^ ^In^' ® '^^ 
e=i 1=1 

D^Tn = for every > 3. Therefore, 

N N 

WDr^Wl = 256(c6„)-2^ A|,„Cl,„, WD^r^Wl^^^ = 256(c6„)-2 ^ A|,„. 

1=1 1=1 

In view of the Rosenthal inequality, we get 

En[||i?r„||^] < C{p)b-^{^,l{^ + /.2p,„ + 4'). 

for every p > 2. Using the definition of ^k.m one can check that p2k,n < M4 n • view of inequality 
(23) and the obvious bound /i2,n £ C'r„, we get 

En[||i?r„||^] < Ch~^rlP/\ Y^[\\D^tAUh] < Ch~'rl^'\ Wp > 4. 
Similar arguments yield 

n<] = E^'K] < C(l + 6-PE[ry2]) < c{l + b-ny^ + T^P/X^PlAniaT]) < 00. 
To check condition (4) of Theorem 4, we use the inequality 

P(|r„| > 1/2) < P(2-8m2,„(c6„)-' > O) + P (8(c6„)-i I ^ A|,„(CL - 1)1 > I/2). 

^ 1=1 ' 
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On the one hand, since the event {2 — 8/i2,n(c^ri)^^ > 0} = {\2,n — c < — c/2} is inchided in 
An{aY, its probabihty is o{h^) for every p > 1. On the other hand, combining the Tchebychev 
and the Rosenthal inequahties, for every fc > 16 we get 

P 8(c6„)-i| ^A,2,„(CL. - 1) > 1/2 < Cb-^ntH[n + ^^2k,u] < Cb-'^nrl'^'] 
^ (=1 ^ 

< Ch-^^'^^l^ + Ch-^V{A^{ar) = 0{hl). 

Thus, we proved that conditions (2)-(5) of Theorem 4 are fulfilled and that sup„ || A'„||p^4 < 
oo. Condition (6) is ensured by Theorem 2. To complete the proof, it remains to check that 
sup„ ||y„||p.4 < oo. This inequality can be proved using the identity 3^„ = + $^), where 

$^ and $^ arc the random variables defined in the proof of Lemma 5. The proof is rather 
technical, but is based on the arguments that we have already used several times in this and the 
previous sections. Therefore it will be omitted. □ 

In the case when the sampling scheme is generated by two Poisson processes, we get the 
following consequence of the last theorem. 

Proposition 9. Let the sampling times of processes Xi and X2 be generated by two independent 
Poisson processes with intensities npi and np2, P1P2 > 0. // 

• the sampling times are independent of the process X , 

• the functions ai, 02 and p are Lipschitz continuous, 

• SUPtg[o^T] 

then 



f7'l||p,4 < 00 for allp> l,ij€ {1,2}, 



sup 

/G£:(A/,7)n£0(C,T,,ro,c*) 



nf{n'/'{0n~O))]- / f{z)pl{z)dz 



(35) 



where 



pI{z) oc 



7(2c) 



'2-KC 



{2kz'^ - 6kcz + Ac z) 



is a probability density with 



2 

Pi 
1 

Pi 
1 

Pi 



2 

P2 

1 

P2 
1 

P2 



i(Tl,tO-2,tPt)'^dt, 



h{tf dt 



Pi + P2 Jo 

3pj + 2piP2+3pl 2 2 

— / <^i,t<^2,thW dt, 
Jo 



? 9 
P1P2 



f {ai,tE(/3W , + fill tPt) + ^2,tE(/3W + /3g t) + mPi,tP2,t]}dt. 
Jo 



Proof. Lemmas 16-19 (cf. Section 9) imply that the partitions generated by independent Poisson 
processes satisfy Assumptions PI and P2. Therefore, using Theorems 5 and 3, we get the desired 
result. □ 
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7. Proofs of theorems and propositions 



Proof of Proposition 6. Let us recall the relations 

rT 

n V 2p-i / ((Ti,tf72,tpt)' dt, i = 1,2 

/en, 

/•T 

n V W(/ n J)2 2(pi + P2y^ / ((Ti,t(T2,tPt)2 

/,J 

proved in Hayashi and Yoshida [19]. The aim of the present proposition is to show that the rate 
of convergence in these relations is and to get an exponential control of the probabilities 

of large deviations. Thus, let us denote Ti = n'Y^j jVi{I)v2{J)Kij and show that 

P( 71 - 2{p-,'+p^') j\l,al,dt > ^) < Cne~^/^. 

Let N{x) ~ \nT/x\ be the smallest positive integer such that N(x)x > nT and let us set 
Li — [iTN{x)~'^ , {i + l)TN{x)~^]. The intervals Li define a uniform deterministic partition of 
[0, T] with a mesh-size of order x/n. Let £ be the event "for every i = 1, . . . , 47V (x), the interval 
Ujv^a) ' 4jv(a")" ] contains at least one point from Hjj and one point from H^/'. The total probability 
formula implies that 



Ti 



h{t)dt 



> 



< P 



Ti 



h{t) dt 



> 



where £'^ denotes the complementary event of £ and h{t) — 2{p^ ^ + P2 t'^2 t- Easy computa- 
tions show that P(f ^) < Cnx~^e~^^'-^ for some C > 0. 

Let now li be a point in L,; such that h{t) dt ~ h{li)\Li\. Let us denote by a/ the left 
endpoint of the interval / and define the random variables 



h{h) J2 \I\\J\KijliareL,}, * = 1, • • -^Nix). 



LJ 



In what follows, we denote by the conditional expectation given £. It holds that 7i 
J^^h{t)dt = rii+ri2 + Ti3 + 0{n\Li\^) on£, where 

.N{x) -, T [Nix)/2] 



Til - 



-/ h{t)dt, Tls^ W2^+s-2-'E■'W2^+s-2]), ^ = 2, 3. 

^=l -I i=l 



For evaluating the remainder term in 7i, we have used the Lipschitz continuity of ui and cr2, as 
well as the fact that r„ < \Li\/2 on £. 

Remark that in view of Lemma 4, for any p > 0, wc have 

E[rfJ = / P((nr„)f > t) < Cn-^ / (ne"* ) A 1 = Cn^f 0(logf n). (36) 
Jo Jo 



On the one hand, since | X]i=i v^l — C'ri,r„, we have 

Af(a;) Ar(.T) 



i=l 



< 



nE[r„lgc 
P(£) 
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Using the inequality of Cauchy-Schwarz, as well as the bounds P(£'^) < Cne and (36), we 

get |E^[X;,=^f^ <] - ^{Ylllf I ^ Cne-^/^, for some constant C and for every x > Clogn. 
On the other hand, in view of Lemma 15 presented in Section 9 below, we have 



E 

I-.aieLi 



<CnE[(r„ + n-i)(|L,|+r„)]. 



Therefore, using (36), wc get E[?/°] ~ 0{n -'^ log'^ n) for every i < N{x). Using once again 
Lemma 15, we get 



N{x) 
i=l 



N{x)-1 



5^ nM/,)E[ ^ |/|-En^( ^ \J\K 

N{x)-1 

J2 nh{k)i:[ (|/p + 2|/|/(np2)) 



(^) 



o 



log^ 



I-.aieLi 



Wald's equality yields E 



'^^'^), for every 



fc > and for every i < N{x) — 1. Here, Ni{Li) is the number of points of ^i^" lying in Li and 
( ^ (S'{1), the exponential distribution with parameter one. Putting all these estimates together, 
we get 



N{x) 



N{x)-1 



2\L, 



1=2 

(- + -) Em^i^^ 



npi 



2\L,\ 
np2 



N{x) 



o 



o 



log^ ^ 



log n 



Since k has been chosen such that h{li)\Li\ — h{t)dt, the last relation implies that Tii = 
0{n-^log^n). 

The advantage of working with 77° s is that, conditionally to £, the random variables 772 j, 
i — 1, . . . , [N{x) /2] , are independent. Indeed, one easily checks that conditionally to f , 772^ depends 
only on the restrictions of ^i'" and ^^,11 qj^^q ^j^g interval [ ^2jv("2)^ ' ^2jv(a\'^ ]- ^i^^e these intervals 
are disjoint for different values of i € N, the restrictions of Poisson processes Sfl^-"^ ^ k ~ 1, 2, onto 
these intervals are independent. Therefore, 772^, i = 1, . . . , [N{x)/2], form a sequence of random 

variables that are independent conditionally to £. Moreover, they verify \r]°\ < Cn\Li\'^ = " ■ 
These features enable us to use the Bernstein inequality in order to bound the probabilities of 
large deviations of 7i2 as follows: 



P^(|ri2| > x/y/^) < 2exp (- 



C(l + 2:77-1/2 log^n) 



< 2e-^/^, 



for every a; > 1. Obviously, the same inequality holds true for the term Tis- These inequalities 
combined with the bound on the error term Tii complete the proof of (28). 

Moreover, since 7i2 and 7i3 are zero mean random variables, conditionally to and has a 
probability bounded by Cne~^^^ , it follows from the computations above that 

rT 

E[ri]=2{p^^+p^^) / <jltal,dt + 0{n-Hog''n). 



Similar arguments entail that E [277/^2. ?i] = c + 0(77 ^ log^ 77). 



□ 
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Proof of Proposition 7. The assertion of the theorem follows from the following relations: 



E 



E 



6 



/en. 



9 ? . 

n^Pi Jo 



h{tfdt + 



log n 



, i = l,2, 



I,, J 

Y.[£v{inJ)Mi) 

I.. J 



6 



n^PilPi +P2Y Ja 



ij 

'e[^v{i n J)v{i)v{j) 



'n?P2{pi +P2Y Jo 
4 



h{tf dt + O 

Jo 

^ - log^ n 



log 71 



h{ty dt + O 



E 



[j2viI^J)vi{I)v2{J) 
IJ 



2 , ^„ „ , c^2 pT i^/j.\3 



6pl + 4pip2 + 6pi [^^^)\h^q( log' 



PI 



Let us prove in detail the fifth relation. The proofs of the other relations are based on similar 
arguments and are easier than that of fifth relation. 

Using the Lipschitz continuity of the function h, one can check that v{I H J)v{I)v{J) = 
h{aiY\I\ ■ \ J\ • |/ n J| + 0(rfj|/ n J|, where a/ is the left endpoint of the interval /. 

In view of (36), we have 'e\J2i,j f^ J\ < TE[rl] = c(^^). On the other hand 



E 



[Y^Hajm ^ |j||/n J|] =e[^ Ma/)'|/|E^( ^ |J||/n J| 



/eni 



JGn2 



Jen^ 



where E^ is the conditional expectation given /. According to Lemmas 13 and 15, presented in 
Section 9 below, 



E^( J2 \ J\\if^J\ 



Jens 

Now, let us show that 
2 

-El 

n L 



2|/| (1 - e-"P2l^l)(e-»P2a7 g-np2(T-bz)^ 

np2 



2 2 

1^ P2 



Ti:= E 

np2 



7Gni 

r2:^E[j:Ha,r\i r — 

%:=E[Y,hiair\I 



, h\t)dt + 0{n-'^), 
n^PiP2 Jo 



n^P2 

(^l _ g-np2\I\--jp-np2{T~bi) 



/eni 



9 9 



0(n-3), 
= 0(n-3). 



To this end, we use the characterization of a Poisson process as a renewal process with exponential 
waiting times. Let {Qki > 1) be a sequence of i.i.d. random variables drawn from the exponential 
distribution with mean l/{npi). Then iVi, can be defined by iVi = inf{fc > 1 : + . . .+Cfc > T"} 
and S"* (Ci + . . . + CO A T for i = 1, . . . , iVi. In this notation. 



7Vi-l 



i=l 



i=l 



n^Pl 
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where ||/i||oo ~ '^'<^'y^te[<d,T\ Remark that A^i is a stopping tirae with respect to the filtration 

Fk = cr(Ci: ■ ■ ■ Xk), k > 1. It is easily seen that 



k-l 



1=1 



are J^^-martingales for whieh the eonditions of the optional stopping theorem are fulfilled. There- 
fore 



i=l 
. Afi-1 



-np2S 



These relations imply that 



Ti = 



n^PiP2 Jo 



h{tfdt + 0{n-^), ITal < 



\h\\ 



n^Pl Jo 



-"-P^' dt + 0{n'^) = 0{n'^). 



In the above inequalities we used the fact that for any integrable function / on [0, T], the equality 



EE-LV fiS')] = npi /; f{t) dt holds true. 

The term Ti can be bounded in the same way as 72 by using the fact that if {ti, . . . , i^r} is a 
realization of a homogeneous Poisson point process in [0, T], then {T—ti, . . . , T — In} can be seen 
as a realization of the same Poisson point process. This completes the proof of the proposition. □ 

Proof of Theorem 4. Let ipn be some truncation functional to be defined later and let C,{x) = 
1 + |a;p" [x e M'^), where m is an integer such that 2m > 7 + d. We have 

E[/(Z„)] =E[/(Z„)^„]+E[/(Z„)(l-VvO] = / /(x)p„(x)dx + E[/(Z„)(l-^„)], 

J»^ 

where Pn{x) = 4^ e""''^ gl{u) du, with g°{u) = E[e'"-^-Vn]- 

We will show below (cf. (38)) that the term E[/(Z„)(1 — ipn)] is o(s„) and is negligible with 
respect to Ei[f{Zn)ipn]- To deal with this latter term, let us introduce the notation 



'h'iiu) du, 



hl{u) = *„[e"'-^] + s„E[e'"-'*'- iu ■ y,, 
5„(u) =E[e™-^"^„C(2n)], 

K{u) = C{-idu)hl{u) = \I'„[e'"-C(a^)] + s„E C(-ia„)(e'"-^iu) 



y=X„ 



Using the Integration By Parts (IBP) formula, we get 
1 



C{x)pn{x) 



jniu)du, ({x)h,^{x) 



1 



Further, there is a linear form C2ix, y)[-] of polynomial elements such that 
Cix + y) ^ + dCix) [y] + C2 (x, 2/) 



'^hn{u) du. 
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for x,y G M''. We also notice that, for all u,y e R'*, 

C(-ia„)(e™-^^m) - C(-i9n)9,e™-«=aj,(C(-i5„)e'"-'') 

Let = /(x)/C(a;) and A„ = {u e M.'^; \u\ < s'^}. Then 

(2^)^/ /(x){p„(a;)-;i°(a;)} = A{n) + SnB{n) + SnC{n) + slDin) + E{n), 



31 



where 



— lu-x J pi 



E 

/ dx^{x) f e-'"-^|E[e™-^"^„aC(A'„)[3^„]l -E[e'"-^-9C('^oo)[3^oo]l|rf«, 



■ "'A,. L 

dxifi{x) e~'"'''(g„(u) - /i„(u)) dw. 



S(n) 

C(n) 
Z?(n) 
i?(n) 
Since 

/ dxifiix) f e-™-^E[e™-^"V«C(-^«)l di^- (2^)''eL(A'„)i^„C('^„) 

JR'' L J L . 

and /r, da;v?(x) 4, e"™'"*™ [e™-^^C(a;)] du = (2^)''4'„[v?C], we have 

\A{n)\ < (2^)'^|E[<^(A'„)V'«C('%'n)] -*nK]| 

< (2^)'^|e[</7(A'„)(1-V„)C('^„)]| +F(n) + o(s„) 
from condition (6) of Theorem 4, where 



F{n) = {2TTf [ \^{x)\ dxx [ \ 

/TUd /Ac 1^ 



E 



^■^C(^)]|} 



du. 



In what follows C denotes a generic constant independent of n and w and it varies from line to 
line. 

To evaluate F(n), we need the explicit form of ipn- Let us denote by i/i a smooth function from 
R into [0, 1] such that ^/'(i) = 1 if \t\ < 1/2 and %lj{t) = if \t\ > 1. We can write 



det 



= 1 + s„ det cr-y'^ Kn 



with a certain functional Kn satisfying, for every p > 1, the condition sup,j j|/i„||p,£„i < 00. Let 
V'n = 2s„ det cr^'' _ftr„ j . Obviously, tjjn G np>iDp.f_i; in order to prove it, replace ax,^ by 
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o'A'„ + k ^Id, differentiate, and take limits in i^-spaces as fc — > oo. Furthermore, we infer that 
sup„ llV^nllpZ-i < CO for every p > 1. If ipn > 0, then dct{<7^^<7z„) > 1/2 leading to 



det az„ > - det ax,^ ■ 



(37) 



By applying the IBP formula and the non-degeneraey assumption for Xn under truncation, we 
find that sup„ |E [e Cl-^n)] | ^ i+\u\'-i '^'^^ ^ ^ Combined with condition (6), this 
implies that F{n) = O(s^j) — o(s„). Besides, 



E 



<p(A'„)(l - llj„)CiXn) < Cg\\l - t/jnWq = o(s„). 



Here q is arbitrary constant such that q G (0, 1). Consequently, A{n) ~ o(s„). 
Taking the limit of sup„|E[C(-i9„)(e'"'^iu) _ ' 3^n] | < T+j|p2 , we get 



E 



C(-ia„)(e'"-^iu) 



< 



c 



u 



1-2 



(38) 



for all w G M'^. On the other hand, from the IBP formula in view of the uniform nondegeneracy 
of Zn under truncation deduced from that of Xn by (37), it follows that sup„ |gn(u)| < 

for all u £ M.^. From these estimates, we have E{n) = O(s^) = o(s„). Similar argument yields 
the estimate sup„ | £*(«.)! < oo. 

To obtain C{n) ~ o(l), we apply Lebesgue's dominated convergence theorem in conjunction 
with the estimate 



sup 



E 



E 



< 



for all u e R'^. In the same way, we can obtain B{n) = o(l). However, we have to use more 
elaborately the estimate 



sup 1a„(u) 



E 



e™-^"iu-3^„ 



exp(is,iU • ynS)ds ^nCi^n) 



< 



(C is independent of u) and its limiting version |E[e™ '^°°iu • 3^ooC('^cx))] | < ■ 

Combining all the estimates, we get J^j f{x)pn{x) dx — f{x)h^(x) dx = o(s„) as n — > oo. 
From the definition of h'^{x), it is easy to show that X^^ has a differentiable density p"^" and that 



dx 



(x) — s„div|E[3^oo I <%'oo = x]p'^'^ (2^)|- The existence of the integral J^^ f{x)h^^{x)dx 



is ensured as a consequence under the assumptions of Theorem 4. 



□ 



8. Convergence of martingales and quadratic variations 

This section collects the proofs of technical results stated in Section 5. The major part of them 
make use of stochastic analysis and aim at controlling quadratic variations and covariations of 
some martingales. 
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Proof of Lemma 5. Let us denote by $^ the difference h 
form $1 = bn^^^{<i>l + $3), where 



-1/2^^ 
'n 



and write it in the 



*n = ^^^iJ{i(lM ■ Ot X {(Jaa) • B2}t + {(J/32) • OIt x {(/ai) • Bi}t 
I, J 

$3 = ^ A7j{(//3i) • X {(J/32) • Or 



7, J 



Since we will be interested in applying martingale limit theorems, it is convenient to decompose 
3>^s in a sum of a martingale and a bounded variation process. This is achieved by the Ito formula, 



'S>l^Y. Kij[{{{{lM ■ t){Ja2)} -32}^ + {{((J/32) • t)ila^)} ■ B,} 
I.J 

+ E Ku[[{{{Ja2) ■ S2)(//3i)} • t]^+[{{{Ia,) ■ B,){JP2)} ■ t] 



The last two terms in this expression need some further analysis. Let us introduce the notation 
= E/„/ Kij{{{{ Ja2) ■ B2)(//3i)} • t]^. Since ((JV2) • Ba)^ = for s e (0,rJ-i), 



$21 ^ 



^ K.,,[{{{J^a2) ■ B2)P[13,,T^-. + (l(T.-,oo)/3f') • t 

id 

+ (l(T3-i,oo)/3ii) ■ Bi + {l(Ti-^, 00)^12) ■ B2]} ■ 

J2 K,,{{{J^a2) ■ i?2}/*/3i,T.-0 -iT + Y. A7j(/{(Ja2/3i\l) • {B2, • tr 

i,j U 

+ I<Ij{l{iJ'^2^12) ■ {B2,B2)})-tT+Op{b^). (39) 



/,,/ 



Let us explain how the last op{bn) is obtained. In fact, the remainder term in the last equation 
contains five summands which can all be treated similarly. Let us do it for one of them, which 

has the form = Y^jj KIJ^^{[{{Jcr2) ■ S2}/3i\'] • • tr- Wc first use that 

= E{ [{{iJiI)<^2) ■ 521/3™] • B,)l] ■ tT 



T 

"-Jo 



<y2.u dB2,u]l3^iLdBi 



Then, by the Cauchy-Schwarz inequality and the martingale property of the stochastic integral, 
we get 

^""[^l] < { [^''^lKi)l.(7)(-)rfi] 4.'^-)(E"[(/3lt)'])'^'rf^ 



^ ^ / f\ll |J|l/(/)(")lj(/)(s)l ' duds < |/| |/'| I J(/) n J(/')P < Crl 

Jo Jo J -' J J, 

under the assumption that maxjgjg.T] E[(/3[\' ()■*] and max^gjo^T] o'2,t are finite. Now, interchanging 
the order of integrations, the first summand in the RHS of (39) can be rewritten as follows 



{((J'T2) • B2)//3i,T.-i} • tT = {{{S' - S'-^ V ■) + JcT2l3i,T.-i} ■ ^2}^ 



(40) 
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Using the same kind of arguments, one can check that the term — ~ admits the 
representation 

$f :=^/0,/{{((M)-i?i)(J/32)}-4 

L.J 

= ^ A-,, ({((r^ - r^-i V •)+M/?2,s.-0-^i}t 

+ /U7(j{(M/3W)-(i32,i?i> + • • tT + Op(&„). (41) 
/,,/ 

Combining (39)-(41) and using that {Bi,Bi)t — (-82,52)4 = t, (i?2,Si)t = JoPsds wc get the 

desired result. □ 

Proof of Lemma 6. Wc will prove only the first relation, the proof of the second being quite 
similar. Consider the case = 1, the case ly = 2 can be treated similarly in view of the relation 
{Bi,B2)t = /q Psds and the boundedness of p. To simplify subsequent formulae, let us denote 
^[11] = 6,7^''^ Y^ij Kij{{J(j2 ■ B2)I<Ji\ ■ {Bi,Bi). In other words, ^'^^l is a random process indexed 
by t e [0, T] defined by 



J J Jo Jo 

= '^Kij / lj{s)a2,s / li{u)(Ti^ududB2,s 
I.J ''^ 

= / '^'i-j{s)cr2,s / \i(,j){u)ai.ududB2,s- 

Jo J Js 



The latter expression implies that conditionally to n„, ^[^^1 is a Gaussian process with zero mean. 
Moreover, 

E" [(d"' )'] = ^" ' E / ^A'Hs ( f {U)CT,,U du^ ' ds 

J 

where C is a positive constant. This yields the desired result. □ 
Proof of Lemma 7. One easily checks that 

/ mY^ml^^d{Bi,B2)s= I ^/i.i^,';(s)(Ja2-B2).(/ai-Bi),(is. (42) 

Jo Jo jj 

To prove the convergence of this expression, we apply the Ito formula to the product (J(T2 ■ 
B2)sil^i-Bi)s: 

{J<J2 ■ B2)s{I'Ji ■ B,)s = {{Ja2 ■ B2)Iai ■ B,}, + {{la, ■ B,)Ja2 ■ B2}s + {{Uh) ■ t},. 
One can show that the contribution of the first two terms is asymptotically negligible, that is 

/ y h,Kl){s){{{Ja2 ■ B2)I<Ji ■ Bi}, + {{lai ■ B{)Ja2 ■ B2}s) ds — ^ 0, (43) 
■^^ I.J 
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Thus, the main term is 



f j2KKr,{s){iijh)-t},ds. 



(44) 



To prove (43), we show the convergence in L^. More rigorously, using the notation Kfj^s) 
Kjj {s)hs ds and interchanging the order of integrals, we get 

/,,/ i,J ' 

- I [(^ /?£;(«)( J(72 •B2),/,ai,„)' 

= [ [ ( V'-ft^/j(u)/„(Ti,„J„cr2,i,) dvdu 

Jo Jo ^ T J ' 



I. J 



< 



(^K' I I -rlY. iKMu)^M) dvdu < Cb, 
Jo Jo J J ^ ' 



V. 

n n 



Let US show now that the term (44) converges in probability. Simple algebra allows us to rewrite 
that term in the form 



which in turn is nothing else but /j^ ^s/is'l{,sv,'5'<t} {^n + ~ ^i^''}{ds, ds'). The weak con- 
vergence of measures stated in Assumption PI completes the proof of the first assertion. The 
proof of the second assertion is quite similar and therefore is omitted. □ 

Proof of Lemma 8., Using the representations of M" and iV" as stochastic integrals, we get 



(45) 



Let us denote by G^^'" the first summand &„ ^ J2i j Kij{{{jP2) ■ i)(^cri)} in G^'" and let us show 
that HJ'"GJ;^'" ds tends to zero in probability as n ^ oo. Simple algebra yields 



IY'GY^" ds ^ b-'/^ y^L^ls J{I)uP2,udu JiI)u<J2.udB2,uds 

Jo J 'Jo Jo 

= K^^^ / X!^'*'^M'^2,aj(^)(s- aj(/)) / J{I)ua-2,udB2,uds 
Jo J ' Jo 

+ K'"^l Y^^^^lsf J{I)u{P2,u~ P2,a,^,,)du[ J{I)u02,udB2,uds 

Jo J Jo Jo 

'■= 71,, I + 72, n, 

where we denoted by aj(i) the left endpoint of the interval J {I). Let us show that both 7i,ri a-nd 
Ti.rt tend to zero in probability. Indeed, 



E"[ri2j=fo,T'En[ / 4„(^J(/)„/' hal,{s-aj(i))dsP2.a,,, 



du 



< Cb-^-E^ 



(j2Hl)u\I\\J{im2.a,^,,\ydu]<Cb-^rt sup E[/32 
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and, after applying the Cauchy-Schwarz inequality several times, 



< b-'rt 



t nt 



JO 



Similar arguments yield the convergence to zero of the sequence E[(/q Hg'"G^^'" ds)^]. Thus 

/o Hi'"Gi'"ds tends to zero in probability as n — > cx). The convergence to zero of the other terms 
of the sum in the right-hand side of (45) can be shown similarly. □ 

Proof of Lemma 9. Let us prove the first assertion, the proof of the second one being com- 
pletely similar. Since N"^ = G"'^'" • Bi + G"'^ • B2 with G^'" and G^'" defined in Lemma 5, we 
have (iV", Bi)t = /g (Gj-" 4- GJ-^s) ds. It is easily seen that 

£ Gi'" ds = /* {((-^'f^^) ■ t)sl>hs + {T' - T^-' V s)+/>i,,/32,s.-i) ds 

(/32.«cri,sl(w <s) + l{u > s)ai^sl32,s) Vy{ds,du) 
+ b-' J2 f{T^ - T^-' V s)+/>i,,(/32,s.-i - p2,s) ds. 

Since /32 is an Ito process with /32°' , I3^2i ^-iid /?22 being uniformly bounded in L^-norm, the 
expectation E'^[|/32.5i-i — P2,s\] is bounded up to a constant factor by |/|"'^^^. This implies that 
the second term in the last formula is Op{b~'^^j j Kij\lf'l'^\J\) ~ Op(rj^^^6~^), while the first 
term converges to /J /32,sCri.s V^''^ {ds) in view of Assumption PI. 

Identical arguments imply the convergence of J^^G^^-^psds to /3i,s(T2,sPsV'^''^(rfs) and the 
assertion of the lemma follows. □ 

Proof of Lemma 10. Since A^" — G^'" • Bi + G^'" • B2, its quadratic variation is given by 
(iV", AT") = [(Gi'")2 + 2Gi^"G2'"p + (G2'")2] . t. Using the semimartingale decomposition of P2, 
one checks that 



/ (G^'")2 ds = f (Y^KiJ I Jul32,uduIsai,X'ds + Op{rlb-^) 
Jo Jo ^ J J Jo ' 

= b-'J E^^^t(/ JiI)u(32,uduyds + Op{rlb-') 



o\ sP2.uP2,u' Vy'-''ids,du,du') + Opirlb-^). 



Analogous computations show that 

{Gl'")'ds= f (3,,,(3,,,,<jl,v',-'''{ds,ds\du) + Op{rlb-^), 
Jlo.t]^ 



5i^"G2'"p, ^ / (32.u(3i.s'<7i,s<J2,sPs v/^^^'^^^^'^^^(dH, ds', ds) + Op{rlb-^). 
J[o.t]^ 

Now, the desired result follows from Assumption P2. □ 
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9. Technical results on Poisson point processes 

Lemma 11. For every X > it holds that J^kLo k\{k+2) ^ A^^(Ae'^ — + 1). 

Proof. It follows from the equality l/(fc!(fc + 2)) = l/((fc + 1)!) - l/((fc + 2)!) and the power 
series expansion of the exponential function. □ 

Lemma 12. Let he a homogeneous Poisson point process on R with intensity A > and 
let a € R. For every lo, let Ia{w) be the interval that contains a and that is an element of the 
partition o/R generated by Then \Ia\ is distributed according to the law Gamma(2, A). 

Proof. W.l.o.g. we can assume that a = 0. Since the restrictions of ^ on (— oo, 0) and [0, oo) are 
two independent Poisson processes, the law of \Ia\ coincides with the law of the sum of two i.i.d. 
random variables exponentially distributed with parameter A. Thus the assertion of the lemma 
follows from the well known properties of the Gamma distribution. □ 

Lemma 13. Let £^ be a homogeneous Poisson point process on R with intensity A > and let 
/ = [a, &] C R be some interval. For every lo, let us denote by N = N(ui) the number of points of 
^{lu) lying in I and by ti = tiiuj), i = 1, . . . , N the ordered sequence of these points. Then 



E 



TV 



4+1 



uy 



2(|/|A-1 



A2 



where we used to = a and tN+i ~ b. 

Proof. Without loss of generality, we assume that / = [0, 1]. We use the fact that conditionally 
to N{uj) = fc, the random vector (ii, . . . , tk) have the same distribution as (t/(i), • • • , C^(fc))j where 
Ui, . . . ,Uk are independent uniformly in [0, 1] distributed random variables and C/(i), . ■ ., 
are the corresponding order statistics. Since the joint density of (?7(i), J7(i+i)) is given by 



/( 



C/(„,C/(, + i) 



fc! 



[i ~ iy.{k - i - ly. 



{2:<J/}' 



the expectation E[(?7(i_|_i) — ?7(i))^] is equal to 2/[(fc + l)(fc + 2)]. It is easily seen that E[U'^-^^] = 
E[(l - U^k)?] = 2/[(fc + l)(fc + 2)]. Therefore, 



E 



TV 



'- i=0 -' fc=0 ^ 1=0 

The desired result follows now from Lemma 11 



(fc + l)(fc + 2) 



k=0 



2e-^A 
fc!(fc + 2)' 



□ 



Let us denote by 11^ the partition of [0, Ci] generated by 3^^ . Then 



Lemma 14. Let Ci and 



be a Poisson process with intensity A2 independent o/Ci- 
2 



E 



Jem 



6A1 + 4X2 
A?(Ai+A2)2 



Proof. By rcscaling and by using Lemma 13, we get 



E 



2Cf(A2Ci-l + e'^^^0 
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Therefore, 

f E[C?] - A E[Ci] + ^ E[Cie-^^?^ 
A2 A2 A2 

Ai 6A1 + 4A2 



E 



A2A2 A^Ai A2(Ai + A2)2 Af(Ai + A2)2- 
This completes the proof of the lemma. □ 

Lemma 15. Let I = [a, h] he an interval of [0, T]. If ^ is a Poisson point process with intensity 
A and 11 is the partition of [0, T] generated by ^ , then 



e[^ |J|K/j] = |/| +2A-1 - A-i(e-^" +e-^(^-'''), 
Jen 



E 

,/en 

Proof. We can consider the Poisson point process 3^ on [0, T] as the union of three independent 
Poisson point processes: on [0, a], ^/ on / = [a, 6] and on [6, T]. Let ti < . . . < tjy^ (rcsp. 
t'/< ...<t^Jbe the points of (resp. Then E^j | ^ E[{a~tNj + \I\ + {t'( -b)]. 

For every integer fc > 0, conditionally to Na = k, the random variable t^^ has the same law as the 
last order statistic U(^k) of a sequence Ui, . . . ,Uk of i.i.d. uniformly in [0,a] distributed random 
variables. Therefore, E[a — t^^ \Na = fc] = a/(fc + 1) and 



k\{k + l) A 



The same arguments yield E[t" — 6] = A^^(l — e^'^^^^'*') and the first assertion of the lemma 
follows. Using the same notation, we have ^j|J\/|-|Jn/| = (a — ijVo)(i'i — a) + {b — t'j^^){t'l — b), 
where t[ < . . . < t'j^^ are the points of ^ lying in /. Thanks to the conditional independence 
of tjv„, (i'lj^AT/) ^'^"^ ^1 given Na, Nj and A*";,, as well as the representation by means of order 
statistics of the uniform distribution we get the second assertion of the lemma. □ 

Lemma 16. Let t > and let be a Poisson process on [0, t] with intensity A. We denote by 
n the random partition of [0, t] generated by . For every continuous function h : [0, t]^ — > M, it 
holds that 



AV / h{s,s')dsds' -'^^^2 I h{s,s)ds. 



Proof. Let be a positive integer and let as denote by 

Wh{5) ^ max{\h{s,s') - h(u,u')\ : {s,s',u,u') G [0,T]* and |s - u| < S, \s' - u'\ < S} (46) 

the modulus of continuity of h. Since h is continuous and [0, t]'^ is compact, we have Wh{t/K) — >■ 
as iiT — > 00. 
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It holds that A X^/en Iixi '^') ~ ^ /o •s) '^^ + 7i + + with 

1=1 -^^ 

where Ilf is the restriction of the Poisson process 3^ on the interval [(i — l)t/K,it/K]. For the 
first term, easy algebra yields 

K K 

E[|ri|]<A||/.||„oE[^|/p-^ ^ +A«;,(t/A')^E[ ^ |/p . 

/en i=i /enf s=i /enf 

This inequality combined with Lemma 13 implies that 

limsupE[|ri|] < limsup (A||/i||oo^ + \wh{t/K)'^) = 2twh{t/K). 

In order to bound E[|72|], we evaluate E[|A^jg]-[A- |/p — ^|]. The value of this term being 
independent of i, we only evaluate the term corresponding to t = 1. Let {Cj, j e N} be a 
family of i.i.d. exponentially distributed random variables with sealing parameter one and let 
N = min{fc : Ci + • • • + Cfe > npt/K}. Then 



2(iV-l) 2t 



A K 



a+2 



Note that E[<;^^] = 6 by virtue of Lemma 12. In view of the Cauchy-Sehwarz inequality and 



Wald's identity [40, Ch. VII, Thm. 3, Eq. (15)], we get E[| J2f=iiCj - 2)|] < [Var(C?) E(iV) 
0{X^^^). Finally, it is clear that jTil < 2twhit/K). Putting these estimates together, we get 
limsup;^_j.oQ E[|7i +72 +73I] < 4:twh{t/K). Using the fact that Wh{t/K) tends to zero as if — >■ 00, 
we arrive at the desired result. □ 

Lemma 17. Let t > and let i — 1,2, he two Poisson processes on [0,t] with intensities 
Xi, i ~ 1,2. Let W be the random partition of [0,i] generated by i = 1,2 and let Aq = 
AiA2/(Ai + A2). For every continuous function h : [0,t]^ — >■ M there exists a constant C > such 
that for every x £ [C log Aq, CAg^^] the inequality 

XoT^Kij f his,s')~2 f\is,s)ds >^ + Cx(\ +wJ^))) < CAoe"-/^ 
'J^ Jixj Jo VAq/// 

holds for sufficiently large Aq, with Wh{-) being defined by (46). 

Proof. W.l.o.g. we assume that t = 1. Set T ~ Xq X^/eni Jen^ Ijxj ^^'^ ~ 

h{s, s). Let us denote by N{x) = [Aq/x] the smallest positive integer such that N{x)x > Aq and 
let us set Li = [iN{x)~^ , {i-\-l)N{x)~^]. The intervals Li define a uniform deterministic partition 
of [0, 1] with a mesh-size of order x/ Aq . Let £ be the event "for every i = 1 , . . . , 4iV (cc) , the interval 
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[ iN(x) ' AN(x) ] contains at least one point from 11^ and one point from 11^" . The total probability 
formula implies that 



r-2 / h{s)ds 



> 



< P 



r-2 / h{s)ds 



> 



where S"^ denotes the complementary event of £. Easy computations show that, for some C > 0, 
the inequality P{£'^) < CXox~^e~^^^ holds true. 

Let now k be a point in Li such that h{t) dt = h{li)\Li\ and let aj be the left endpoint of 
/. We define the random variables 

r,° = XoHk) \I\\J\I<iA{areU}. * = -^N^x), 
I. J 

and write 71 = Tii + 7i2 + Tis + 0{Xo\Li\whi\Li\)) on f , where 

.Af(a; 



^77° -2 / h{s)ds, Tu 
,=1 -I -^0 



[N{x)/2] 



Let us emphasize that for evaluating the remainder term in 71, we have used the fact that 
r = max/gni |7| V maxjgn^ |7| < \Li\/2 on £. 

On the one hand, since | 'J2illi'' Vil ^ CXor, we have 



N{x) N{x) 



i=l 



i=l 



< 



AoE[rlgo] 
P{£) ■ 



Using the inequality of Cauchy-Schwarz, as well as the bounds P{£'^) < CXqc and (36), we 
get < CAoe-^/<=', for some constant C and for every a; > ClogAo. 

On the other hand, in view of Lemma 15, we have 



E[77°] < Xoh{h)E 



Using once again Lemma 15, we get 



< CXoHk)iX^' + X^')\L,\ = 0(.tAo 1). 



N{x) N{x}-1 

i=i 



E XoHk)-E[ E |7|-En^(E^/./l'^ 

1=2 i-.aieLi jen^ 

N(x)-1 

E AoM/.Oe[ E (|7P + 2|/|/A2)] +0(xAo-1). 



OfxAn 



I:aieLi 



Wald's equality yields 



E 



[ E 



1/1' 



^ =fc!|i,|A}-'^ + 0(Ar"), 

r.ai^Li 

for every fc > and for every i < N{x) — 1. Putting all these estimates together, we get 



(47) 



N{x) 

e[E<]= E -AoM^.)(^ + ^)+0(xAoi)=E2M?.)|/^d + 0(^Aoi). 



Af(2:)-1 



'2\L,\ 2\L 



N{x) 
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Since k is chosen to verify h{li)\Li\ = h{t) dt, we get Tii = 0{xXq^). 

The advantage of working with ri°s is that, conditionahy to £, the random variables ri2i, 
i = 1, • ■ ■ , [N{x)/2], are independent. Indeed, one easily checks that conditionally to £, ri2i depends 
only on the restrictions of and onto the interval [ 2lv7a: j ' trn^) ] • ^i^^ce these intervals 
are disjoint for different values of i G N, the restrictions of Poisson processes 3^^, k = 1,2, 
onto these intervals are independent. Therefore, 773^, i = 1, . . . , [iV(x)/2], form a sequence of 
random variables that are independent conditionally to £. Moreover, conditionally to f , they 
verify \r]°\ < CXor\Li\ < Cx^/Xq. One can also check that 'E^M)^] = 0{x^Xo^). 

These features enable us to use the Bernstein inequality in order to bound large deviations of 
7i2 as follows: 

P^dTd > x/^o) < 2exp ( -y;) 3^ ) < 2e-/^, V..e[l,Ay«] 

Obviously, the same inequality holds true for the term 7i3. These inequalities combined with the 
bound on the deterministic error term 71 1 complete the proof. □ 

Lemma 18. Let T > and let S^l^, i = 1,2, be two Poisson processes on [0,T] with intensities 
npi, i = 1,2. For every continuous function h : [0,T]^ — >■ M, it holds that 



/eni 



I* 8 /^"^ 

/ h{s,t,u) ds dtdu ^(^H 1 — 5- J / h{s,s,s)ds. 

Jixjmxjm ^Pi P1P2 P2^ Jo 



Proof. Let us denote Tn = S/eni Iix j(i) x /(/) ^' '^^ '^^ ^'^'^ consider the uni- 

form partition {Li = [(i — l)/iV, i/iV), i = 1, . . . ,iV} with N = [n^~^] slightly smaller than n 
(e is a small positive number). For every integer i smaller than [ri"'^"'^], we define U as the real 
number such that h{li) = \Li\^^ Jj^ hs ds, where hs = h(s, s, s). The continuity of h implies that 



N 



r„ = n2(l + o(l)) ^ \JiI)\'U. iaj). 



=1 / 



For every i, we set r]° = J2i ^(^i)l^l \J{^)\'^'^Li{o-i)- We first remark that 

E[Yh{k)\L\\J{I)\^^M] =N-'0{nrl]), \fi = l,...,N. 
I 

Let now i & 2, . . . , N — 1 and / be an interval of 11^ satisfying aj & Li, then 1 1>/(7)| — — "^2 | — 
— A''~-'^)_|_ + (^2 ~ where ^J' and ^2 are two random variables distributed according to 

the exponential distribution with parameters np2 conditionally to 11^. Moreover, conditionally to 
ni, and are independent. Since N = 0{n^-'') and E" [(^J)^] = 0{n-'^), by the Cauchy- 

Schwarz inequality we have E"' [(^° - N-^)\] = 0{n-^-'^^) for j = 1,2. This implies that 
En'[|J(/)|2] = +4|/|(np2)"^ +6(np2)^ + 0(|/|n-i-2e)_ Combining this estimate with (47), 
we get 

EK°] = /iG,)|i,|f -I + — + -!) +n2|L,|0(n-i-2e)^ /JL + ^ + ^) / ^(5)^5 + 0(1). 

^pi P1P2 pi^ ^Pi P1P2 Pi ^ J Li 

By reasoning in a similar way, we get E[77°77°] — E[77°]E[?7°] = o(|Lip) as soon as \i — j\ > 2. 
Standard arguments imply that Var^j = 0(A^ max^ Var(77°)) + o{N'^\Li\'^). Since |77°| < 
C(nr„)^|ii| for every i, we get VarE-??"] = 0(iV|Li |2E[(nr„)4]) + o(l) = o(l) and the desired 
convergence property follows from the convergence of Tn in L^. □ 
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Lemma 19. Let T > and let S^]-^, i — 1,2, be two Poisson processes on [0,T] with intensities 
npi, i — 1,2. There is a constant v{pi,p2) depending only on pi and p2 such that for every 
continuous function h : [0, T]'^ — > M 

^2 / h{s,t,u) ds dtdu — - — > v{pi,p2) / h{s,s,s)ds. 

il^i jT^I ^^('^^ ' '^(^^ ^ ^^'^ 

Proof. The proof of this lemma follows from the invariance of the law of a Poisson process under 
scaling and translation, as well as from the independence of disjoint sets' measures. It is similar 
to the proofs of preceding lemmas and therefore will be omitted. □ 
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